-- Logs begin at Fri 2022-04-01 09:22:28 UTC, end at Fri 2022-04-01 10:35:14 UTC. -- Apr 01 09:55:14.179446 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 01 09:55:14.188676 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 01 09:55:14.190642 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 1 09:55:14 2022] *** Apr 01 09:55:14.190642 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 01 09:55:14.190642 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: nodename: dv-cinder-master-3-iscsi Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: machine: x86_64 Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: clock source: unix Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: pcre jit disabled Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: detected number of CPU cores: 4 Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: current working directory: / Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: detected binary path: /usr/bin/uwsgi-core Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: your processes number limit is 47680 Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: your memory page size is 4096 bytes Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: detected max file descriptor number: 2048 Apr 01 09:55:14.190879 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: lock engine: pthread robust mutexes Apr 01 09:55:14.191477 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: thunder lock: enabled Apr 01 09:55:14.191477 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 01 09:55:14.191477 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 01 09:55:14.234794 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: Python main interpreter initialized at 0x5604bb6529c0 Apr 01 09:55:14.234794 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: python threads support enabled Apr 01 09:55:14.234794 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: your server socket listen backlog is limited to 100 connections Apr 01 09:55:14.234794 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: your mercy for graceful operations on workers is 90 seconds Apr 01 09:55:14.235159 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: mapped 403077 bytes (393 KB) for 2 cores Apr 01 09:55:14.235159 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: *** Operational MODE: preforking *** Apr 01 09:55:14.235444 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: *** uWSGI is running in multiple interpreter mode *** Apr 01 09:55:14.235444 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: spawned uWSGI master process (pid: 102697) Apr 01 09:55:14.235648 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 01 09:55:14.236943 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: spawned uWSGI worker 1 (pid: 102698, cores: 1) Apr 01 09:55:14.237245 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: spawned uWSGI worker 2 (pid: 102699, cores: 1) Apr 01 09:55:14.237438 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 01 09:55:15.392863 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 01 09:55:15.424107 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 01 09:55:16.238230 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:55:16.238230 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: from cryptography.utils import int_from_bytes Apr 01 09:55:16.238566 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:55:16.238566 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: from cryptography.utils import int_from_bytes Apr 01 09:55:16.249996 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:55:16.249996 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: from cryptography.utils import int_from_bytes Apr 01 09:55:16.250317 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 09:55:16.250317 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: from cryptography.utils import int_from_bytes Apr 01 09:55:18.735331 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 01 09:55:18.735925 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 01 09:55:18.736285 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 01 09:55:18.736382 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 01 09:55:18.736459 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 01 09:55:18.736524 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 01 09:55:18.736597 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 01 09:55:18.736669 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 01 09:55:18.736733 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 01 09:55:18.736803 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 01 09:55:18.737010 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.737108 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.737362 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.737508 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.737640 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.737738 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.737987 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.738139 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.738316 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.738471 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.738632 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.738793 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.738972 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.739109 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.739300 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.739457 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.739592 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.739688 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.739864 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.739999 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.740191 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.740323 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.740491 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.740597 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.740806 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.740893 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.741109 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.741198 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.741410 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.741506 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.741773 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.741871 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.742019 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.742114 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.742332 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.742437 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.742637 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.742766 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.743151 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.744399 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.744399 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.744644 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.744732 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.744815 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.744899 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745025 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745120 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745205 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745205 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745399 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745481 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745567 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745650 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745797 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745879 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.745956 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.746031 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.746120 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.746263 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.746354 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.746668 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.746758 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.746981 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.747081 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.747293 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.747393 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.747597 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.747694 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748002 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748186 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748277 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748363 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748605 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748737 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748896 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.748995 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.749220 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.749320 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.749519 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.749646 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.749898 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.750014 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.750212 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.750306 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.750525 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.750619 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.750863 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.750965 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.751158 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.751247 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.751455 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.751543 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.751759 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.751847 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752069 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752157 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752364 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752461 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752665 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752759 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752906 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.752992 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.753209 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.753327 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.753517 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.753612 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.753829 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.753919 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.754128 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.754229 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.754371 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.754464 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.754620 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.754765 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.754952 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.755059 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.755267 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.755354 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.755567 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.755662 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.755871 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.755969 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.756175 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.756263 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.756476 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.756612 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.756777 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.756874 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.757086 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.757178 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.757390 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.757487 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.757690 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.757773 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.758000 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.758093 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.758305 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.758399 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.758618 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.758757 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.758947 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.759049 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.759257 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.759359 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.759659 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.759795 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.759905 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.759996 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.760202 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.760287 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.760534 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.760617 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.760841 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.760925 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.761142 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.761227 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.761449 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.761531 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.761762 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.761845 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.762064 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.762149 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.762363 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.762447 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.762699 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.762786 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.762994 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.763089 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.763312 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.763419 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.763609 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.763704 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.763855 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.763950 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.764150 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.764235 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.764447 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.764550 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.764758 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.764849 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.765066 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.765149 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.765383 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.765481 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.765689 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.765772 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.765981 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.766065 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.766288 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.766478 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.766593 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.766827 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.766925 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.767125 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.767236 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.767427 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.767520 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.767725 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.767809 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.768024 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.768118 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.768323 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.768407 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.768621 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.768712 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.768922 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.769049 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.769236 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.769331 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.769548 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.769649 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.769848 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.769945 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.770149 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.770233 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.770445 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.770539 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.770769 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.770874 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.771074 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.771158 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.771372 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.771456 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.771672 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.771765 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.771972 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.772065 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.772267 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.772349 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.772904 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.773067 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.773214 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.773314 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.773519 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.773621 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.773829 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.773926 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.774113 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.774210 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.774408 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.774492 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.774739 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.774839 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.775044 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.775135 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.775341 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.775432 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.775638 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.775729 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.775934 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.776100 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.776272 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.776359 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.776595 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.776696 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.776896 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.776980 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.781828 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.782095 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.782219 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.782579 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.782946 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.783037 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.783286 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.783377 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.783629 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.783725 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.783957 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.784050 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.784282 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.784386 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.784597 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.784688 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.784961 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 09:55:18.785095 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.785300 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.785447 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.785644 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.785789 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.785994 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.786128 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.786308 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.786461 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.786695 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.786827 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.787005 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.787137 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.787318 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.787449 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.787631 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.787777 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.787943 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.788083 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.788247 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.788338 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.788563 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.788662 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.788880 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.788979 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.789200 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.789290 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.789523 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.789613 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.789855 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.789959 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.790173 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.790265 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.790486 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.790576 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.790833 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.790923 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.791144 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.791242 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.791439 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.791524 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.791755 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.791841 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.792078 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.792170 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.792392 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.792485 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.792696 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.792788 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.793035 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.793122 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.793373 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.793456 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.793682 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.793775 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.794006 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.794092 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.794326 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.794418 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.794629 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.794760 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.794961 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.795046 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.795270 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.795378 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.795593 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.795687 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.795913 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.795996 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.796228 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.796319 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.796546 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.796631 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.796895 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.796986 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.797212 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.797296 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.797525 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.797610 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.797834 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.797925 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.798156 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.798254 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.798475 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.798567 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.798821 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.798909 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.799136 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.799221 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.799456 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.799550 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.799766 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.799858 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.800072 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.800212 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.800380 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.800473 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.800687 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.800774 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.800991 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.801157 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.801296 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.801389 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.801596 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.801696 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.801900 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.801993 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.802200 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.802284 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.802531 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.802673 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.802865 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.802974 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.803184 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.803285 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.803500 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.803592 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.803806 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.803912 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.804112 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.804218 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.804421 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.804553 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.804723 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.804811 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.805028 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.805121 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.805334 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.805423 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.805636 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.805720 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.805939 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.806022 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.806250 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.806334 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.806558 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.806687 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.806885 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.806977 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.807200 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.807298 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.807500 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.807583 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.807801 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.807892 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.808112 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.808212 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.808417 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.808506 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.808723 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.808807 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.809027 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.809138 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.809338 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.809485 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.809644 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.809791 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.810007 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.810160 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.810288 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.810370 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.810575 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.810719 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.810927 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.811024 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.811232 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.811323 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.811551 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.811636 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.811866 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.811951 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.812173 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.812265 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.812525 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.812659 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.812830 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.812917 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.813128 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.813232 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.813429 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.813512 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.813728 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.813820 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.814036 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.814122 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.814334 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.814427 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.814638 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.814827 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.814960 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.815056 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.815261 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.815355 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.815559 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.815644 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.815880 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.815964 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.816182 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.816275 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.816478 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.816561 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.816777 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.816871 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.817077 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.817197 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.817413 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.817496 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.817711 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.817797 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.818048 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.818142 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.818377 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.818464 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.818716 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.818805 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.819032 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.819126 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.819338 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.819424 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.819645 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.819729 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.819952 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.820037 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.820260 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.820390 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.820565 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.820658 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.820872 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.820958 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.821179 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.821287 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.821484 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.821576 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.821795 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.821880 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.822099 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.822182 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.822411 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.822753 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.822858 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.823062 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.823149 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.823377 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.823488 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.823682 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.823769 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.823995 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.824093 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.824331 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.824433 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.824648 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.824733 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.824958 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.825044 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.825271 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.825365 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.825572 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.825666 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.825878 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.825964 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.826178 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.826263 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.826486 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.826573 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.826813 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.826901 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.827123 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.827221 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.827433 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.827516 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.827733 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.827816 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.828071 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.828166 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.828378 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.828470 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.828690 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.828780 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.828990 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.829086 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.829299 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.829393 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.829604 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.829690 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.829913 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.830076 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.830233 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.830319 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.830543 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.830662 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.830882 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.830968 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.831191 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.831274 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.831500 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.831584 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.831804 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.831890 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.832107 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.832190 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.832409 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.832501 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.832710 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.832796 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.833013 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.833107 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.833317 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.833402 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.833621 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.833705 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.833923 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.834014 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.834226 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.834324 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.834525 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.834613 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.834861 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.834961 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.835163 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.835256 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.835461 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.835545 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.835758 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.835842 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.836062 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.836229 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.836378 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.836463 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.836681 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.836765 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.836985 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.837079 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.837297 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.837381 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.837586 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.837670 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.837886 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.837980 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.838191 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.838274 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.838493 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.838576 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.838817 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.838904 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.839120 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.839216 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.839426 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.839518 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.839743 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.839828 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.840054 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.840139 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.840352 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.840445 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.840663 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.840757 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.840971 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.841055 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.841270 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.841360 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.841576 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.841660 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.841875 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.841964 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.842180 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.842281 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.842482 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.842566 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.842816 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.842907 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.843118 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.843225 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.843422 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.843507 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.843788 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.843875 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.844115 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.844247 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.844422 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.844509 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.844731 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.844851 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.845044 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.845138 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.845350 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.845437 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.845654 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.845737 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.845956 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.846042 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.846262 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.846537 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.846624 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.846896 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.847211 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.847305 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.847534 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.847620 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.847854 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.847939 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.848167 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.848259 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.848484 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.848571 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.848799 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.848893 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.849132 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.849215 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.849433 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.849527 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.849743 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.849829 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.850050 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.850145 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.850362 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.850448 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.850674 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.850762 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.850990 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.851074 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.851295 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.851380 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.851597 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.851680 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.851897 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.851988 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.852199 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.852293 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.852500 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.852585 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.852795 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.852894 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.853096 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.853182 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.853395 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.853488 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.853696 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.853857 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.854004 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.854090 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.854299 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.854383 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.854606 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.854757 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.854930 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.855023 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.855232 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.855317 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.855535 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.855628 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.855836 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.855921 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.856137 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.856221 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.856436 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.856524 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.856780 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.856873 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.857083 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.857176 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.857414 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.857502 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.857731 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.857815 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.858039 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.858125 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.858353 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.858438 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.858676 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.858762 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.858987 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.859086 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.859330 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.859415 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.859628 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.859721 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.859931 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.860024 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.860239 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.860323 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.860538 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.860622 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.860837 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.860944 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.861142 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.861233 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.861445 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.861535 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.861745 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.861837 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.862044 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.862129 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.862344 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.862475 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.862686 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.862825 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.863001 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.863132 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.863308 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.863441 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.863602 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.863749 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.863915 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.864048 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.864226 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.864355 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.864531 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.864637 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.864843 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.864956 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.865150 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.865239 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.865458 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.865543 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.865756 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.865840 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.866056 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.866139 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.866355 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.866439 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.866667 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.866753 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.866980 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.867076 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.867282 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.867393 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.867590 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.867680 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.867893 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.867987 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.868193 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.868276 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.868498 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.868592 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.868796 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.868888 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.869095 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.869180 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.869394 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.869484 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.869691 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.869784 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.869991 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.870075 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.870294 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.870379 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.870605 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.870722 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.870943 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.871044 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.871239 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.871323 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.871541 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.871627 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.871838 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.871921 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.872141 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.872225 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.872438 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.872524 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.872735 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.872826 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.873032 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.873115 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.873327 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.873411 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.873624 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.873707 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.873918 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.874014 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.874215 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.874304 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.874521 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.874604 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.874901 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.875006 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.875204 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.875297 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.875502 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.875587 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.875800 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.875895 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.876136 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.876228 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.876436 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.876522 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.876765 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.876858 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.877077 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.877160 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.877380 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.877462 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.877689 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.877775 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.877989 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.878072 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.878288 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.878371 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.878590 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.878753 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.878916 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.879003 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.879225 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.879308 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.879527 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.879614 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.879830 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.879914 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.880126 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.880209 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.880428 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.880514 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.880742 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.880833 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.881045 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.881150 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.881350 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.881435 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.881665 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.881749 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.881967 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.882127 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.882275 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.882360 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.882571 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.882713 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.882903 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.882999 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.883205 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.883288 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.883509 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.883595 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.883808 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.883904 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.884109 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.884195 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.884413 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.884496 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.884717 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.884819 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.885020 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.885104 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.885324 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.885416 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.885625 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.885723 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.885924 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.886009 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.886225 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.886317 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.886526 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.886620 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.886852 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.886949 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.887155 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.887239 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.887461 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.887545 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.887761 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.887845 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.888065 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.888159 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.888364 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.888449 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.888668 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.888793 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.888967 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.889105 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.889414 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.889499 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.889719 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.889803 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.890036 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.890136 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.890364 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.890456 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.890698 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.890787 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.891011 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.891109 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.891311 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.891395 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.891619 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.891730 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.891922 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.892045 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.892334 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.892421 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.892643 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.892729 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.892944 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.893038 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.893246 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.893329 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.893547 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.893632 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.893847 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.893933 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.894150 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.894244 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.894450 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.894534 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.894774 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.894890 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.895073 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.895157 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.895374 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.895471 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.895693 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.895777 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.895989 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.896110 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.896307 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.896406 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.896711 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.896795 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.897015 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.897129 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.897315 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.897783 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.898066 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.898152 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.898378 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.898464 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.898709 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.898812 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.899036 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.899122 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.899345 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.899444 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.899660 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.899765 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.899963 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.900059 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.900274 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.900359 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.900579 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.900664 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.900887 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.900985 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.901198 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.901283 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.901499 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.901584 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.901806 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.901893 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.902108 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.902200 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.902420 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.902504 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.902758 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.902860 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.903073 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.903180 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.903392 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.903485 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.903795 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.903891 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.904109 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.904193 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.904417 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.904510 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.904719 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.904843 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.905023 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.905109 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.905329 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.905459 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.905630 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.905716 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.905930 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.906037 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.906278 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.906374 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.906581 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.906733 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.906916 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.907001 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.907217 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.907321 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.907512 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.907598 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.907812 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.907896 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.908110 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.908195 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.908411 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.908495 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.908708 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.908792 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.909023 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.909116 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.909325 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.909409 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.909638 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.909731 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.909946 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.910033 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.910247 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.910343 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.910557 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.910749 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.910883 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.910971 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.911199 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.911339 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.911503 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.911598 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.911800 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.911884 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.912099 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.912184 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.912398 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.912492 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.912730 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.912814 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.913029 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.913115 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.913346 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.913439 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.913658 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.913743 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.913976 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.914060 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.914279 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.914378 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.914600 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.914704 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.914947 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.915053 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.915255 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.915341 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.915559 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.915643 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.915862 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.915948 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.916157 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.916242 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.916455 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.916540 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.916757 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.916849 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.917053 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.917139 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.917354 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.917446 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.917654 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.917738 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.917953 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.918047 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.918251 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.918335 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.918548 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.918683 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.918871 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.918956 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.919193 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.919276 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.919490 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.919586 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.919795 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.919879 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.920093 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.920177 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.920391 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.920488 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.920690 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.920781 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.920987 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.921079 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.921319 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.921451 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.921639 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.921728 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.921964 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.922056 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.922273 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.922365 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.922583 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.922687 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.922929 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.923014 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.923233 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.923328 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.923544 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.923636 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.923852 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.923935 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.924160 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.924254 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.924468 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.924552 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.924775 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.924859 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.925080 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.925167 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.925383 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.925467 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.925689 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.925782 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.925993 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.926078 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.926303 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.926386 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.926614 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.926849 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.926960 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.927182 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.927475 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.927562 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.927796 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.927894 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.928103 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.928187 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.928412 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.928496 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.928719 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.928841 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.929025 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.929110 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.929331 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.929415 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.929637 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.929730 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.929942 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.930027 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.930247 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.930333 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.930551 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.930639 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.930896 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.930982 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.931214 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.931298 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.931530 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.931615 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.931847 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.931932 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.932155 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.932249 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.932469 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.932563 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.932777 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.932861 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.933086 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.933181 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.933412 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.933498 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.933726 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.933812 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.934024 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.934124 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.934336 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.934423 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.934640 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.934745 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.934975 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.935061 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.935283 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.935387 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.935588 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.935689 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.935895 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.935988 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.936200 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.936284 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.936505 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.936607 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.936808 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.936894 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.937115 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.937200 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.937476 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.937573 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.937794 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.937888 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.938103 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.938187 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.938418 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.938505 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.938754 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.938843 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.939072 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.939275 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.939373 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.939591 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.939881 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.939967 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.940194 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.940285 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.940519 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.940605 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.940841 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.940926 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.941155 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.941238 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.941460 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.941584 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.941774 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.941859 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.942080 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.942180 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.942378 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.942461 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.942697 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.942786 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.943004 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.943100 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.943306 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.943389 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.943606 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.943690 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.943909 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.944039 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.944212 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.944305 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.944511 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.944595 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.944827 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.945111 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.945220 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.945379 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.945648 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.945734 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.945994 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.946085 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.946309 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.946402 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.946620 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.946786 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.946954 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.947042 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.947266 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.947350 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.947570 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.947654 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.947876 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.947963 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.948173 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.948259 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.948476 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.948561 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.948775 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.948860 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.949082 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.949168 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.949378 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.949470 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.949679 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.949765 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.949981 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.950066 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.950282 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.950375 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.950581 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.950715 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.950912 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.950997 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.951211 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.951310 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.951517 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.951608 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.951821 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.951914 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.952121 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.952282 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.952421 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.952507 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.952721 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.952823 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.953045 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.953133 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.953343 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.953435 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.953643 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.953729 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.953942 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.954036 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.954243 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.954342 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.954540 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.954633 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.954871 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.954967 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.955167 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.955252 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.955472 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.955567 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.955765 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.955852 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.956071 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.956165 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.956425 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.956520 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.956728 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.956822 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.957025 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.957110 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.957321 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.957415 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.957633 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.957721 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.957940 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.958026 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.958246 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.958339 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.958548 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.958634 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.958877 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.958973 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.959222 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.959436 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.959532 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.959777 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.960049 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.960143 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.960379 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.960466 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.960697 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.960783 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.961019 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.961111 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.961328 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.961415 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.961633 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.961719 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.961933 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.962026 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.962236 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.962324 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.962549 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.962634 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.962886 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.962972 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.963194 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.963281 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.963497 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.963581 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.963803 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.963899 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.964104 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.964227 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.964411 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.964498 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.964713 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.964806 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.965015 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.965100 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.965316 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.965402 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.965622 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.965727 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.965923 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.966053 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.966227 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.966313 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.966537 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.966632 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.966891 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.966976 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.967204 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.967336 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.967517 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.967604 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.967825 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.967909 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.968133 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.968220 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.968437 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.968565 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.968808 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.968894 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.969121 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.969215 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.969425 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.969512 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.969734 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.969819 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.970049 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.970142 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.970357 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.970478 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.970670 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.970816 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.971103 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.971208 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.971415 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.971501 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.971732 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.971818 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.972051 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.972152 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.972355 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.972440 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.972672 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.972758 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.972991 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.973078 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.973300 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.973388 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.973616 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.973700 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.973924 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.974011 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.974249 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.974335 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.974574 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.974687 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.974910 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.975005 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.975218 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.975328 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.975530 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.975627 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.975831 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.975925 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.976134 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.976220 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.976441 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.976541 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.976742 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.976843 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.977046 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.977140 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.977341 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.977433 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.977642 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.977739 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.977947 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.978034 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.978248 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.978334 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.978548 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.978634 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.978873 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.978970 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.979173 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.979266 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.979473 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.979564 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.979773 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.979868 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.980072 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.980164 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.980369 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.980485 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.980668 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.980766 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.980969 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.981063 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.981266 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.981366 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.981564 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.981666 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.981860 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.981968 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.982159 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.982251 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.982458 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.982639 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.982819 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.982963 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.983119 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.983270 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.983413 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.983560 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.983688 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.983784 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.984001 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.984108 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.984374 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.984468 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.984685 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.984871 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.985007 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.985199 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.985328 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.985511 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.985644 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.985832 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.985955 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.986153 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.986298 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.986468 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.986582 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.986799 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.986923 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.987129 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.987228 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.987436 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.987522 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.987745 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.987837 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.988054 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.988144 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.988362 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.988447 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.988669 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.988755 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.988978 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.989066 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.989301 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.989387 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.989626 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.989712 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.989928 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.990015 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.990242 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.990326 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.990552 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.990665 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.990905 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.990992 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.991219 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.991305 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.991529 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.991631 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.991886 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.991981 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.992136 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.992224 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.992445 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.992540 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.992756 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.992848 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.993064 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.993149 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.993372 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.993466 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.993685 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.993771 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.993997 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.994090 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.994317 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.994404 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.994635 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.994775 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.994978 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.995064 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.995301 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.995397 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.995633 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.995717 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.995939 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.996032 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.996244 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.996366 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.996549 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.996635 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.996793 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102698) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 01 09:55:18.996888 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.997173 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.997476 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 09:55:18.997717 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102699) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 01 09:55:19.022105 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_db.sqlalchemy.engines [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.023402 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_db.sqlalchemy.engines [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.084468 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.context [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99e219f2-f124-4025-bb90-a3ae1910c4c9(cell1) {{(pid=102699) load_cells /opt/stack/nova/nova/context.py:464}} Apr 01 09:55:19.084711 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.context [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99e219f2-f124-4025-bb90-a3ae1910c4c9(cell1) {{(pid=102698) load_cells /opt/stack/nova/nova/context.py:464}} Apr 01 09:55:19.088642 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_concurrency.lockutils [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 09:55:19.088793 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 09:55:19.090210 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_concurrency.lockutils [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 09:55:19.090369 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 09:55:19.091042 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_concurrency.lockutils [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 09:55:19.091179 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 09:55:19.092962 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 09:55:19.093117 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_concurrency.lockutils [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102699) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 09:55:19.107216 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_db.sqlalchemy.engines [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.108504 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_db.sqlalchemy.engines [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.111612 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_db.sqlalchemy.engines [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.116355 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_db.sqlalchemy.engines [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.271109 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG oslo_db.sqlalchemy.engines [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102699) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.273688 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_db.sqlalchemy.engines [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102698) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 09:55:19.719814 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: WARNING keystonemiddleware.auth_token [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 09:55:19.720730 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: WARNING keystonemiddleware.auth_token [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 09:55:19.726615 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: WARNING keystonemiddleware.auth_token [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 09:55:19.727236 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: WARNING keystonemiddleware.auth_token [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 09:55:19.942008 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: WARNING keystonemiddleware.auth_token [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 09:55:19.944454 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: WARNING keystonemiddleware.auth_token [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 09:55:19.947189 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: WARNING keystonemiddleware.auth_token [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 09:55:19.949554 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: WARNING keystonemiddleware.auth_token [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 09:55:19.952254 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5604bb6529c0 pid: 102698 (default app) Apr 01 09:55:19.954367 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:55:19.954946 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5604bb6529c0 pid: 102699 (default app) Apr 01 09:55:19.955565 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-b54c7a07-e0a0-4bf8-a18e-6a5ef024d3ea None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Apr 01 09:55:19.955984 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Fri Apr 1 09:55:19 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:38.342717 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:38.343978 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002062 Apr 01 09:56:38.344555 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:38 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:38.784604 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-a432f0a9-befa-43d0-90f6-91c4343b3132 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:38.813328 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-a432f0a9-befa-43d0-90f6-91c4343b3132 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462429 Apr 01 09:56:38.814111 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 1 09:56:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 09:56:41.153891 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:41.155106 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-81baf7d9-938e-40fe-ade9-2a05d0675906 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Apr 01 09:56:41.155785 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:41.227104 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fe4eba7a-038b-44a1-8bf4-7db740626896 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "os-flavor-access:is_public": true, "ram": 256}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:41.246018 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 09:56:41.246018 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: warnings.warn(msg) Apr 01 09:56:41.278089 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fe4eba7a-038b-44a1-8bf4-7db740626896 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116150 Apr 01 09:56:41.279034 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:56:41 2022] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:56:41.517526 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-b7035234-0284-457f-90d4-e781f892900b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:41.520149 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 09:56:41.520149 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: warnings.warn(msg) Apr 01 09:56:41.590258 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-b7035234-0284-457f-90d4-e781f892900b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.303065 Apr 01 09:56:41.590796 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 1 09:56:41 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:56:43.897043 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fe4eba7a-038b-44a1-8bf4-7db740626896 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:43.899068 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fe4eba7a-038b-44a1-8bf4-7db740626896 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002462 Apr 01 09:56:43.899712 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:43 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:44.009586 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-5992141e-04ac-475a-9a98-c07c1004fcf7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "disk": 5, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:44.041606 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 09:56:44.041606 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: warnings.warn(msg) Apr 01 09:56:44.063150 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-5992141e-04ac-475a-9a98-c07c1004fcf7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.157773 Apr 01 09:56:44.063915 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:56:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:56:44.075746 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-cb6aed09-ca81-4b00-bd1b-cdfb72113189 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:44.077284 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 09:56:44.077284 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: warnings.warn(msg) Apr 01 09:56:44.116158 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-cb6aed09-ca81-4b00-bd1b-cdfb72113189 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043931 Apr 01 09:56:44.116835 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 1 09:56:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 09:56:46.417980 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-5992141e-04ac-475a-9a98-c07c1004fcf7 admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:46.419009 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-5992141e-04ac-475a-9a98-c07c1004fcf7 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Apr 01 09:56:46.419739 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:46.484174 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-2959f328-a75e-4257-bdcc-f57623d289be admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0, "ram": 1024, "rxtx_factor": 1.0, "vcpus": 1, "id": "d2", "disk": 10}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:46.505324 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-2959f328-a75e-4257-bdcc-f57623d289be admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.079328 Apr 01 09:56:46.506276 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:56:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:56:46.518600 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-b9cb2efe-188c-4974-954c-9754b5c75ac8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:46.544588 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-b9cb2efe-188c-4974-954c-9754b5c75ac8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029913 Apr 01 09:56:46.550698 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 1 09:56:46 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:56:48.868120 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-2959f328-a75e-4257-bdcc-f57623d289be admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:48.869139 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-2959f328-a75e-4257-bdcc-f57623d289be admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Apr 01 09:56:48.869529 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:48.927181 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-349836af-c4a4-4e3a-b957-fb7922b52d0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "disk": 10, "swap": 0}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:48.946137 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-349836af-c4a4-4e3a-b957-fb7922b52d0d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070719 Apr 01 09:56:48.946774 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:56:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:56:48.958511 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-af205c13-5c35-41c8-ac55-ef4ab62bbbdf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:48.982295 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-af205c13-5c35-41c8-ac55-ef4ab62bbbdf admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027426 Apr 01 09:56:48.983091 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 1 09:56:48 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:56:51.282277 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-349836af-c4a4-4e3a-b957-fb7922b52d0d admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:51.283377 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-349836af-c4a4-4e3a-b957-fb7922b52d0d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Apr 01 09:56:51.283764 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:51.341182 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-a2e354f2-60c0-4233-9f88-d745b7fc126d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4", "swap": 0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 4}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:51.360240 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-a2e354f2-60c0-4233-9f88-d745b7fc126d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070551 Apr 01 09:56:51.361105 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:56:51 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:56:51.373128 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-0a4063f7-b8ad-4080-ae1c-51e28a51ec99 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:51.396745 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-0a4063f7-b8ad-4080-ae1c-51e28a51ec99 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027523 Apr 01 09:56:51.397437 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1335 bytes} [Fri Apr 1 09:56:51 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:56:53.683781 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-a2e354f2-60c0-4233-9f88-d745b7fc126d admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:53.684797 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-a2e354f2-60c0-4233-9f88-d745b7fc126d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Apr 01 09:56:53.685169 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 09:56:53.744518 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-809c16ec-f71d-4727-9325-604cc0343964 admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:53.767790 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-809c16ec-f71d-4727-9325-604cc0343964 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.076169 Apr 01 09:56:53.768327 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 1 09:56:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:56:56.323938 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-a2e354f2-60c0-4233-9f88-d745b7fc126d admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:56.325033 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-a2e354f2-60c0-4233-9f88-d745b7fc126d admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Apr 01 09:56:56.325540 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:56:56.388451 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-1bc6c0ac-b8b1-40b5-a5b6-70aba39dc5bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny", "ram": 512, "disk": 1, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:56.407515 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-1bc6c0ac-b8b1-40b5-a5b6-70aba39dc5bc admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076082 Apr 01 09:56:56.408121 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:56:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:56:56.421303 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-ddef0368-bc53-4aee-993b-f51372a40c9e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:56.447664 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-ddef0368-bc53-4aee-993b-f51372a40c9e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030326 Apr 01 09:56:56.448226 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 1 09:56:56 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:56:58.832931 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-1bc6c0ac-b8b1-40b5-a5b6-70aba39dc5bc admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:56:58.833999 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-1bc6c0ac-b8b1-40b5-a5b6-70aba39dc5bc admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Apr 01 09:56:58.834434 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:56:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 09:56:58.922756 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-498d5c33-8a02-47ff-8122-42f55dadc073 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "name": "m1.small", "os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:58.941356 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-498d5c33-8a02-47ff-8122-42f55dadc073 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.100796 Apr 01 09:56:58.941923 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:56:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:56:58.955549 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-63cbe69b-130e-4792-9967-fcd95529af73 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:56:58.981878 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-63cbe69b-130e-4792-9967-fcd95529af73 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030579 Apr 01 09:56:58.982471 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 1 09:56:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 09:57:01.855675 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-498d5c33-8a02-47ff-8122-42f55dadc073 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:01.856691 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-498d5c33-8a02-47ff-8122-42f55dadc073 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Apr 01 09:57:01.857088 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:57:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:01.918427 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-a34cf25b-b6dd-4d37-8e27-48688cd75214 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "id": "3", "name": "m1.medium", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "ram": 4096, "disk": 40}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:01.936927 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-a34cf25b-b6dd-4d37-8e27-48688cd75214 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.074108 Apr 01 09:57:01.937604 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:57:01 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:57:01.949304 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-dbd6b398-49e4-442f-bfc1-a9d923a7dc62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:01.973810 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-dbd6b398-49e4-442f-bfc1-a9d923a7dc62 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028281 Apr 01 09:57:01.974381 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 1 09:57:01 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 09:57:04.280226 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-a34cf25b-b6dd-4d37-8e27-48688cd75214 admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:04.281999 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-a34cf25b-b6dd-4d37-8e27-48688cd75214 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002226 Apr 01 09:57:04.282475 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:57:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 09:57:04.344356 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-bac6a9fe-2160-4916-bbac-44a81b772c02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "disk": 80}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:04.364859 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-bac6a9fe-2160-4916-bbac-44a81b772c02 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076397 Apr 01 09:57:04.365512 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:57:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:57:04.377261 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-aa419a46-f69c-4fbe-8ef7-1ce3ebc82e71 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:04.400944 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-aa419a46-f69c-4fbe-8ef7-1ce3ebc82e71 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027511 Apr 01 09:57:04.401560 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 1 09:57:04 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:57:06.729080 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-bac6a9fe-2160-4916-bbac-44a81b772c02 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:06.730782 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-bac6a9fe-2160-4916-bbac-44a81b772c02 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002172 Apr 01 09:57:06.731186 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:57:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:06.794751 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-606db4c6-a881-41a7-9c03-44e503f79dbd admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "swap": 0, "vcpus": 8, "name": "m1.xlarge", "disk": 160}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:06.814324 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-606db4c6-a881-41a7-9c03-44e503f79dbd admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.077224 Apr 01 09:57:06.815210 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1282 bytes} [Fri Apr 1 09:57:06 2022] POST /compute/v2.1/flavors => generated 408 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 01 09:57:06.827168 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-5dfdb0ca-f664-4609-ad05-5bcfbc99bd1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:06.851780 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-5dfdb0ca-f664-4609-ad05-5bcfbc99bd1d admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028323 Apr 01 09:57:06.852375 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1332 bytes} [Fri Apr 1 09:57:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:57:29.514707 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-606db4c6-a881-41a7-9c03-44e503f79dbd admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:29.515756 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-606db4c6-a881-41a7-9c03-44e503f79dbd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Apr 01 09:57:29.516254 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:29.575390 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-31e1f32f-47a5-48b7-9a93-05c7aa80c1f3 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:29.592448 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-31e1f32f-47a5-48b7-9a93-05c7aa80c1f3 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070409 Apr 01 09:57:29.592987 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 1 09:57:29 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:57:30.939963 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-606db4c6-a881-41a7-9c03-44e503f79dbd admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:30.940987 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-606db4c6-a881-41a7-9c03-44e503f79dbd admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001565 Apr 01 09:57:30.941352 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:31.152463 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-e086623b-317b-495f-9c51-7bc10622457a admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:31.158564 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.wsgi [None req-e086623b-317b-495f-9c51-7bc10622457a admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 01 09:57:31.159158 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-e086623b-317b-495f-9c51-7bc10622457a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 09:57:31.159959 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-e086623b-317b-495f-9c51-7bc10622457a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.067736 Apr 01 09:57:31.160448 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 1 09:57:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:31.170139 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-5348af10-70a7-4386-86d1-1c47432ece7b admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:31.190915 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-5348af10-70a7-4386-86d1-1c47432ece7b admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024432 Apr 01 09:57:31.191476 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 1 09:57:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:57:31.201197 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-227b29dc-7e06-4706-9a3f-b66d6e45b803 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:31.222564 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-227b29dc-7e06-4706-9a3f-b66d6e45b803 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024962 Apr 01 09:57:31.223123 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 1 09:57:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:57:31.232436 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-3e184abd-242b-40ae-8ba9-e5571ffdcc1a admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:31.238276 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.wsgi [None req-3e184abd-242b-40ae-8ba9-e5571ffdcc1a admin admin] HTTP exception thrown: Flavor 42 could not be found. Apr 01 09:57:31.238898 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-3e184abd-242b-40ae-8ba9-e5571ffdcc1a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 09:57:31.239736 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-3e184abd-242b-40ae-8ba9-e5571ffdcc1a admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010970 Apr 01 09:57:31.240215 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 1 09:57:31 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:32.495550 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-227b29dc-7e06-4706-9a3f-b66d6e45b803 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:32.496569 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-227b29dc-7e06-4706-9a3f-b66d6e45b803 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Apr 01 09:57:32.496978 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:32.691152 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-921deeef-9664-4446-afa9-d25e6e486cdf admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:32.696792 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.wsgi [None req-921deeef-9664-4446-afa9-d25e6e486cdf admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 01 09:57:32.697355 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-921deeef-9664-4446-afa9-d25e6e486cdf admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 09:57:32.698156 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-921deeef-9664-4446-afa9-d25e6e486cdf admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.067571 Apr 01 09:57:32.698686 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 1 09:57:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:32.708408 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-e0ad3a9e-162c-45b9-9464-8fe4484a48ad admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:32.721869 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-e0ad3a9e-162c-45b9-9464-8fe4484a48ad admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017210 Apr 01 09:57:32.722383 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 1 09:57:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:57:32.734041 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-46b1ba94-94fe-4ba5-bb6f-2e1b8275abfa admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:32.747931 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-46b1ba94-94fe-4ba5-bb6f-2e1b8275abfa admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017300 Apr 01 09:57:32.748460 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 1 09:57:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:57:32.757828 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-2e3f6a41-e778-4a19-8b0a-92023685a646 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:32.763692 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.wsgi [None req-2e3f6a41-e778-4a19-8b0a-92023685a646 admin admin] HTTP exception thrown: Flavor 84 could not be found. Apr 01 09:57:32.764247 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-2e3f6a41-e778-4a19-8b0a-92023685a646 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 09:57:32.765038 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-2e3f6a41-e778-4a19-8b0a-92023685a646 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010778 Apr 01 09:57:32.765528 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Fri Apr 1 09:57:32 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:34.038719 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-46b1ba94-94fe-4ba5-bb6f-2e1b8275abfa admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:34.039884 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-46b1ba94-94fe-4ba5-bb6f-2e1b8275abfa admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001953 Apr 01 09:57:34.040338 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:34.252090 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-542e1873-45f8-4098-b8eb-9b2349b9e83d admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:34.257534 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.wsgi [None req-542e1873-45f8-4098-b8eb-9b2349b9e83d admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 01 09:57:34.258091 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-542e1873-45f8-4098-b8eb-9b2349b9e83d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102698) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 09:57:34.258918 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-542e1873-45f8-4098-b8eb-9b2349b9e83d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072528 Apr 01 09:57:34.259417 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 1 09:57:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Apr 01 09:57:34.268963 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-1b284405-b834-47a1-9939-e19650d55e83 admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:34.283415 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-1b284405-b834-47a1-9939-e19650d55e83 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018024 Apr 01 09:57:34.283936 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 1 09:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:57:34.293705 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:34.306927 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017170 Apr 01 09:57:34.307454 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Fri Apr 1 09:57:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 09:57:34.316426 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-13935017-be93-4497-ab40-6ddfe7ea7ddd admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:34.323799 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.wsgi [None req-13935017-be93-4497-ab40-6ddfe7ea7ddd admin admin] HTTP exception thrown: Flavor 451 could not be found. Apr 01 09:57:34.324709 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-13935017-be93-4497-ab40-6ddfe7ea7ddd admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102699) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 09:57:34.326018 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-13935017-be93-4497-ab40-6ddfe7ea7ddd admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012879 Apr 01 09:57:34.326905 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 1 09:57:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Apr 01 09:57:35.584506 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:35.585531 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Apr 01 09:57:35.585927 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:35.785869 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-53780ab0-e270-4646-9ae4-4a056f79bcd6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:35.806170 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-53780ab0-e270-4646-9ae4-4a056f79bcd6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085788 Apr 01 09:57:35.806705 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 1 09:57:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:57:37.045791 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:37.046822 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Apr 01 09:57:37.047235 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:37.250530 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-ad2c0095-c0dd-4e8f-8454-2a1a9f40008b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:37.271033 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-ad2c0095-c0dd-4e8f-8454-2a1a9f40008b admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.089391 Apr 01 09:57:37.271522 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 1 09:57:37 2022] POST /compute/v2.1/flavors => generated 405 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:57:38.528652 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:38.530445 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001946 Apr 01 09:57:38.530879 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:38.731971 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-3ce8cc6d-62f5-4652-82d8-40b378fc101a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:38.753249 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-3ce8cc6d-62f5-4652-82d8-40b378fc101a admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.085716 Apr 01 09:57:38.753726 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 1 09:57:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:57:39.998946 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:40.000138 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001896 Apr 01 09:57:40.000712 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:40.193131 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-6769baa6-e4be-4437-80e0-f350e83b73de admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 09:57:40.213228 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-6769baa6-e4be-4437-80e0-f350e83b73de admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076913 Apr 01 09:57:40.213679 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Fri Apr 1 09:57:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 09:57:41.534586 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:41.535647 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Apr 01 09:57:41.536038 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 09:57:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:57:41.732055 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-ffaff188-aab6-47c9-bad3-414388bf163c admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:57:41.757481 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-ffaff188-aab6-47c9-bad3-414388bf163c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.088763 Apr 01 09:57:41.758002 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Fri Apr 1 09:57:41 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:58:31.714386 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:58:31.715445 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-fc623b5c-ea7c-45a5-9b0a-a1e69c979cb2 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Apr 01 09:58:31.715836 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 930 bytes} [Fri Apr 1 09:58:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 09:58:31.785765 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-24be043b-6d34-4aa4-a6b3-81838a3b3141 admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:58:31.805264 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-24be043b-6d34-4aa4-a6b3-81838a3b3141 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.083172 Apr 01 09:58:31.805779 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1291 bytes} [Fri Apr 1 09:58:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 09:58:31.829688 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-067a0d1a-86e3-4a69-a76e-155b9539bcf4 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:58:31.842030 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-067a0d1a-86e3-4a69-a76e-155b9539bcf4 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018045 Apr 01 09:58:31.842575 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1282 bytes} [Fri Apr 1 09:58:31 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 09:58:31.856681 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-210ac5d9-191d-4a64-b1f5-a8a74590d455 admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:58:31.867980 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-210ac5d9-191d-4a64-b1f5-a8a74590d455 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016730 Apr 01 09:58:31.868663 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1285 bytes} [Fri Apr 1 09:58:31 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 09:58:31.882498 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-62fe7094-b819-4772-8e6a-01557f393600 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:58:31.893711 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-62fe7094-b819-4772-8e6a-01557f393600 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.016681 Apr 01 09:58:31.894341 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1285 bytes} [Fri Apr 1 09:58:31 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 09:58:31.908831 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 09:58:31.916575 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011202 Apr 01 09:58:31.917098 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1282 bytes} [Fri Apr 1 09:58:31 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:00:28.341774 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-9fbfbe76-52b3-4484-b2b2-d15abf374e24 tempest-verify_tempest_config-2055913671 tempest-verify_tempest_config-2055913671-project] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:00:28.343817 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-9fbfbe76-52b3-4484-b2b2-d15abf374e24 tempest-verify_tempest_config-2055913671 tempest-verify_tempest_config-2055913671-project] 10.222.0.46 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.121220 Apr 01 10:00:28.344393 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 35/69] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Apr 1 10:00:28 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:02:02.311300 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:02.312322 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Apr 01 10:02:02.312718 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 35/70] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 10:02:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:02:02.574584 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-9dbffc7d-3c85-46aa-9910-694a0db422fb admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:02.575774 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:02:02.575774 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: warnings.warn(msg) Apr 01 10:02:02.576960 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-9dbffc7d-3c85-46aa-9910-694a0db422fb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:02.577387 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-9dbffc7d-3c85-46aa-9910-694a0db422fb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:02.578157 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-9dbffc7d-3c85-46aa-9910-694a0db422fb admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:02.578573 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-9dbffc7d-3c85-46aa-9910-694a0db422fb admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:02.611378 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-9dbffc7d-3c85-46aa-9910-694a0db422fb admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.159571 Apr 01 10:02:02.611917 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 36/71] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 1 10:02:02 2022] GET /compute/v2.1/os-services => generated 791 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:02:03.893538 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:03.894686 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 Apr 01 10:02:03.895164 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 36/72] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 10:02:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:02:04.099625 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-36bd718c-c03f-4112-8afe-3a69cbeccab0 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:04.100822 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:02:04.100822 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: warnings.warn(msg) Apr 01 10:02:04.102031 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-36bd718c-c03f-4112-8afe-3a69cbeccab0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:04.102464 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-36bd718c-c03f-4112-8afe-3a69cbeccab0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:04.103273 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-36bd718c-c03f-4112-8afe-3a69cbeccab0 admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:04.103690 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-36bd718c-c03f-4112-8afe-3a69cbeccab0 admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:04.123202 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-36bd718c-c03f-4112-8afe-3a69cbeccab0 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.093391 Apr 01 10:02:04.123757 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 37/73] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 1 10:02:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:02:15.829753 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:15.830513 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Apr 01 10:02:15.830928 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 37/74] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 10:02:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:02:16.040890 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-73d553f6-3221-4902-b4d9-e2ad486c9a1a admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:16.042053 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:02:16.042053 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: warnings.warn(msg) Apr 01 10:02:16.043290 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-73d553f6-3221-4902-b4d9-e2ad486c9a1a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:16.043976 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-73d553f6-3221-4902-b4d9-e2ad486c9a1a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:16.044785 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-73d553f6-3221-4902-b4d9-e2ad486c9a1a admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:16.045208 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-73d553f6-3221-4902-b4d9-e2ad486c9a1a admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:16.068994 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-73d553f6-3221-4902-b4d9-e2ad486c9a1a admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.092849 Apr 01 10:02:16.069498 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 38/75] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 1 10:02:15 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:02:17.331124 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: DEBUG nova.api.openstack.wsgi [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] Calling method '>' {{(pid=102699) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:17.332227 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: INFO nova.api.openstack.requestlog [None req-f28cc260-05db-4a00-bec7-d36f806a214e admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001614 Apr 01 10:02:17.333012 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: [pid: 102699|app: 0|req: 38/76] 10.222.0.46 () {56 vars in 1074 bytes} [Fri Apr 1 10:02:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:02:17.524890 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG nova.api.openstack.wsgi [None req-a12a3636-26a6-4942-b735-c060f63ae4c1 admin admin] Calling method '>' {{(pid=102698) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:02:17.526401 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Apr 01 10:02:17.526401 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: warnings.warn(msg) Apr 01 10:02:17.527627 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-a12a3636-26a6-4942-b735-c060f63ae4c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:17.528060 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-a12a3636-26a6-4942-b735-c060f63ae4c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:17.528836 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-a12a3636-26a6-4942-b735-c060f63ae4c1 admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:02:17.529251 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: DEBUG oslo_concurrency.lockutils [None req-a12a3636-26a6-4942-b735-c060f63ae4c1 admin admin] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102698) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:02:17.549962 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: INFO nova.api.openstack.requestlog [None req-a12a3636-26a6-4942-b735-c060f63ae4c1 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078478 Apr 01 10:02:17.550425 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: [pid: 102698|app: 0|req: 39/77] 10.222.0.46 () {60 vars in 1193 bytes} [Fri Apr 1 10:02:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:03:14.343367 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Apr 01 10:03:14.344034 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: Fri Apr 1 10:03:14 2022 - graceful shutdown triggered... Apr 01 10:03:14.344495 dv-cinder-master-3-iscsi devstack@n-api.service[102699]: Gracefully killing worker 2 (pid: 102699)... Apr 01 10:03:14.344867 dv-cinder-master-3-iscsi devstack@n-api.service[102698]: Gracefully killing worker 1 (pid: 102698)... Apr 01 10:03:15.345091 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: worker 1 buried after 1 seconds Apr 01 10:03:15.345091 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: worker 2 buried after 1 seconds Apr 01 10:03:15.345091 dv-cinder-master-3-iscsi devstack@n-api.service[102697]: goodbye to uWSGI. Apr 01 10:03:15.347270 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Apr 01 10:03:15.348200 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Apr 01 10:03:15.351779 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Apr 01 10:03:15.366346 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Apr 1 10:03:15 2022] *** Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: nodename: dv-cinder-master-3-iscsi Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: machine: x86_64 Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: clock source: unix Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: pcre jit disabled Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: detected number of CPU cores: 4 Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: current working directory: / Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: detected binary path: /usr/bin/uwsgi-core Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: your processes number limit is 47680 Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: your memory page size is 4096 bytes Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: detected max file descriptor number: 2048 Apr 01 10:03:15.389468 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: lock engine: pthread robust mutexes Apr 01 10:03:15.390581 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: thunder lock: enabled Apr 01 10:03:15.390581 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 01 10:03:15.390581 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Apr 01 10:03:15.436754 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: Python main interpreter initialized at 0x55cfbbdb89c0 Apr 01 10:03:15.436754 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: python threads support enabled Apr 01 10:03:15.436754 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: your server socket listen backlog is limited to 100 connections Apr 01 10:03:15.436754 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: your mercy for graceful operations on workers is 90 seconds Apr 01 10:03:15.437420 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: mapped 403077 bytes (393 KB) for 2 cores Apr 01 10:03:15.437420 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: *** Operational MODE: preforking *** Apr 01 10:03:15.437571 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: *** uWSGI is running in multiple interpreter mode *** Apr 01 10:03:15.437571 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: spawned uWSGI master process (pid: 117047) Apr 01 10:03:15.437699 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Apr 01 10:03:15.438423 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: spawned uWSGI worker 1 (pid: 117065, cores: 1) Apr 01 10:03:15.439269 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: spawned uWSGI worker 2 (pid: 117066, cores: 1) Apr 01 10:03:15.439269 dv-cinder-master-3-iscsi devstack@n-api.service[117047]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 01 10:03:16.620791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 01 10:03:16.621395 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 01 10:03:17.537971 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 10:03:17.537971 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: from cryptography.utils import int_from_bytes Apr 01 10:03:17.538312 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 10:03:17.538312 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: from cryptography.utils import int_from_bytes Apr 01 10:03:17.538450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 10:03:17.538450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: from cryptography.utils import int_from_bytes Apr 01 10:03:17.539073 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Apr 01 10:03:17.539073 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: from cryptography.utils import int_from_bytes Apr 01 10:03:19.889843 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 01 10:03:19.890422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 01 10:03:19.890751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 01 10:03:19.891357 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 01 10:03:19.891357 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 01 10:03:19.891761 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.892093 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.892419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.892764 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.893239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.893409 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.893756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.894095 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.894429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.894717 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.895041 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.895557 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.895901 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.896213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.896534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.896855 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.897170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.897500 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.897841 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.898314 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.899973 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.899973 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.900666 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.901449 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.902181 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.902481 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Apr 01 10:03:19.903060 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Apr 01 10:03:19.903643 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.904266 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Apr 01 10:03:19.904549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.904680 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Apr 01 10:03:19.904895 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Apr 01 10:03:19.905291 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.905472 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.905669 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.906004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.906158 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.906334 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.906672 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.906787 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.907039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.907143 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.907325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.907447 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.907645 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.907945 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.908049 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.908215 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.908311 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.908589 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.908730 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.908912 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.909062 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.909232 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.909388 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.909539 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.909724 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.909847 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.910063 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.910163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.910383 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.910474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.910748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.910860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.911083 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.911189 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.911416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.911582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.911748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.911892 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.912061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.912196 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.912382 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.912505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.912702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.912836 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.913031 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.913131 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.913346 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.913444 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.913663 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.913772 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.913921 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.914037 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.914237 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.914357 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.914568 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.914682 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.914928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.915085 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.915260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.915400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.915507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.915729 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.915857 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.916034 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.916144 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.916399 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.916505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.916722 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.916825 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.917039 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.917140 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.917353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.917469 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.917664 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.917765 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.917967 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.918057 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.918279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.918377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.918591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.918724 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.918930 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.919034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.919247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.919337 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.919547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.919655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.919854 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.919961 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.920160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.920251 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.920483 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.920587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.920791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.920894 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.921092 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.921182 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.921395 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.921498 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.921701 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.921805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.922017 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.922122 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.922426 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.922523 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.922778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.922886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.923030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.923122 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.923282 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.923389 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.923598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.923704 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.923916 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.924007 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.924222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.924321 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.924532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.924634 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.924838 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.924928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.925144 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.925235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.925447 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.925539 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.925769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.925884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.926058 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.926167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.926363 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.926469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.926697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.926807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.927013 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.927140 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.927303 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.927388 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.927619 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.927728 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.927932 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.928050 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.928246 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.928362 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.928553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.928658 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.928858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.928960 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.929167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.929263 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.929479 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.929578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.929785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.929881 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.930093 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.930188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.930405 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.930495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.930752 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.930858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.931076 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.931167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.931390 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.931476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.931702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.934730 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.934849 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.934929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.934999 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935167 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935167 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935411 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935512 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935592 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935682 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935776 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.935944 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936014 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936173 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936251 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936401 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936470 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936548 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936637 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936723 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.936986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937057 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937126 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937204 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937411 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937501 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937572 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937725 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.937950 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938413 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938664 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.938837 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.939107 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.939208 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.939282 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.939365 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.939660 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.939754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940013 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940227 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940485 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940584 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940848 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.940943 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.941154 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.941252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.941472 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.941571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.941778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.941867 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.942084 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.942182 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.942400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.942489 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.942720 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.942836 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.943029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.943127 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.943343 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.943440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.943649 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.943755 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.943949 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.944047 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.944252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.944341 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.944556 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.944660 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.944859 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.944948 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.945161 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.945265 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.945463 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.945562 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.945763 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.945853 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.946059 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.946149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.946375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.946464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.946708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.946812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.947023 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.947120 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.947330 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.947429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.947634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.947723 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.947951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Apr 01 10:03:19.948041 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.948285 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.948386 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.948614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.948711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.948953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.949067 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.949354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.949475 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.949585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.949691 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.949933 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.950046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.950215 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.950325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.950528 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.950617 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.950865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.950964 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.951188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.951279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.951497 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.951587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.951807 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.951896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.952119 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.952218 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.952434 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.952576 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.952797 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.952895 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.953115 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.953205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.953428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.953516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.953762 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.954035 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.954145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.954373 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.954474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.954566 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.954665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.954755 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.955033 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.955125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.955372 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.955474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.955722 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.955825 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.956100 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.956200 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.956420 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.956547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.956757 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.956886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.957072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.957175 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.957388 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.957515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.957699 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.957808 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.958013 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.958149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.958326 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.958443 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.958641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.958911 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.959039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.959163 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.959302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.959651 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.959794 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.960123 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.960273 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.960403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.960538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.960674 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.960810 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.960945 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.961080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.961207 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.961341 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.961469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.961469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.961753 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.961753 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962027 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962298 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962434 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962574 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962727 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.962992 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.963134 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.963271 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.963406 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.963537 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.963664 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.963823 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.964095 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.964238 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.964450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.964586 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.964724 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.964851 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.964992 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.965120 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.965244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.965369 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.965493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.965673 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.965850 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.965980 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.966130 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.966299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.966437 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.966607 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.966770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.966929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.967050 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.967247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.967389 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.967527 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.967655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.967828 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.967970 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.968145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.968275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.968464 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.968595 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.968769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.968908 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.969091 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.969230 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.969400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.969750 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.969932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970070 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970070 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970726 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.970986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.971243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.971243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.971482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.971617 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.971737 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.971872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972009 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972297 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972686 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972825 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.972998 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.973129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.973329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.973473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.973659 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.973797 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.973981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.974126 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.974283 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.974429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.974604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.974769 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.974942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.975058 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.975247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.975376 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.975557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.975688 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.975860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.975997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.976164 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.976325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.976461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.976597 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.976764 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.976893 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.977069 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.977213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.977375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.977513 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.977680 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.977817 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.977984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.978147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.978276 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.978412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.978593 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.978758 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.978933 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.979078 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.979237 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.979379 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.979543 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.979687 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.979998 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.980134 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.980261 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.980421 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.980548 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.980700 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.980926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.981060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.981195 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.981322 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.981458 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.981585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.981719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.981855 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.982021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.982185 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.982322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.982450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.982636 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.982852 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.982978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.983116 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.983269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.983398 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.983582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.983720 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.983970 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.984099 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.984295 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.984472 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.984610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.984746 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.984912 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.985043 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.985234 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.985377 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.985547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.985678 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.985866 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.986004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.986172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.986314 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.986522 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.986676 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.986816 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.986943 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.987137 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.987277 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.987455 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.987585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.987771 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.987900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.988085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.988230 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.988401 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.988531 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.988710 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.988838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.989022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.989155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.989334 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.989464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.989642 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.989771 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.990103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.990266 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.990387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.990512 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.990694 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.990834 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.991074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.991205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.991331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.991456 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.991592 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.991799 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.991938 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.992074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.992201 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.992331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.992456 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.992610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.992814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.992953 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.993080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.993214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.993342 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.993483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.993610 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.993744 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.993883 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.994020 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.994195 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.994334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.994501 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.994641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.994833 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.994961 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.995139 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.995288 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.995444 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.995578 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.995753 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.995890 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.996068 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.996207 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.996378 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.996508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.996714 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.996850 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.996986 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.997114 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.997274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.997412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.997579 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.997709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.997882 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.998012 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.998184 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.998341 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.998495 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.998624 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.998837 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.998976 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.999146 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.999276 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.999513 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.999645 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.999834 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:19.999978 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.000293 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.000427 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.000553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.000720 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.000857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.000993 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.001218 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.001350 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.001475 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.001611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.001739 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.001940 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.002069 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.002226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.002357 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.002536 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.002695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.002863 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.003002 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.003178 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.003308 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.003498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.003636 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.003808 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.003946 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.004122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.004264 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.004432 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.004562 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.004740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.004879 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.005060 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.005202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.005402 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.005533 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.005714 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.005857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.006022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.006160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.006364 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.006497 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.006633 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.006802 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.006969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.007111 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.007277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.007414 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.007592 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.007723 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.007899 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.008026 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.008205 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.008342 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.008507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.008636 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.008811 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.008933 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.009123 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.009251 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.009429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.009695 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.009835 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.010030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.011003 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.011176 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.011407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.011407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.011672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.011802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.011928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.012070 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.012205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.012342 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.012480 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.012641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.012770 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.012907 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013049 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013177 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013570 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013570 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013817 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.013945 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.014085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.014213 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.014337 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.014503 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.014640 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.014832 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.014972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.015124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.015259 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.015386 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.015510 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.015636 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.015774 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.015910 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016288 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016421 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016677 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016835 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.016961 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.017096 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.017231 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.017365 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.017501 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.017628 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.017754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.017878 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.018018 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.018156 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.018282 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.018407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.018546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.018691 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.018910 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.019038 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.019166 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.019293 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.019418 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.019559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.019686 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.019821 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.020012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.020142 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.020365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.020518 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.020667 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.020807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.020986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.021253 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.021366 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.021585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.021703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.021890 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.021982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.022197 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.022303 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.022504 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.022601 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.022834 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.022926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.023163 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.023269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.023479 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.023570 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.023788 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.023879 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.024097 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.024198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.024732 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.024831 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.025051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.025152 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.025353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.025454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.025663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.025756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.025965 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.026055 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.026278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.026381 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.026586 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.026709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.026915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.027015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.027218 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.027311 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.027528 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.027634 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.027837 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.027948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.028135 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.028232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.028441 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.028540 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.028741 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.028840 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.029051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.029196 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.029339 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.029475 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.029639 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.029778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.029944 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.030084 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.030256 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.030388 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.030822 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.030963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.031554 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.031775 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.031918 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032055 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032055 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032307 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032562 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032688 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032820 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.032975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.033116 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.033244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.033373 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.033498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.033624 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.033758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.033896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034291 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034436 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034572 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034713 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.034981 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.035109 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.035247 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.035455 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.035594 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.035736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.035863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.035999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.036126 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.036288 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.036426 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.036553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.036690 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.036826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.036961 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.037098 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.037234 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.037370 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.037504 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.037629 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.037770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.037905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.038032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.038158 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.038314 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.038445 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.038632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.038811 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.038969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.039101 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.039285 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.039415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.039598 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.039778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.039908 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.040091 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.040223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.040414 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.040756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.040893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.041031 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.041159 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.041292 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.041428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.041564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.041692 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.041910 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042185 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042745 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.042980 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.043133 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.043267 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.043436 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.043567 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.043754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.043884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.044065 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.044203 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.044376 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.044507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.044697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.044835 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.045016 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.045147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.045338 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.045477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.045642 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.045789 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.045953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.046090 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.046285 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.046419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.046594 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.046790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.046932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.047060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.047222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.047360 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.047532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.047743 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.047874 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.048000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.048136 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.048296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.048435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.048612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.048743 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.048946 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.049079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.049235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.049377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.049549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.049687 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.049875 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.050013 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.050183 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.050324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.050491 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.050631 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.050922 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.051065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.051202 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.051339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.051476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.051613 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.051740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.051866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.052090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.052237 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.052390 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.052534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.052701 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.052830 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.053021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.053184 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.053324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.053461 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.053600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.053736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.053900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.054129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.054276 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.054414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.054541 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.054720 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.054865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.055000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.055226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.055356 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.055538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.055660 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.055845 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.055980 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.056263 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.056426 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.056612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.056782 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.056933 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.057072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.057220 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.057358 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.057495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.057646 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.057826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.057961 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.058146 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.058317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.058469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.058622 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.058805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.058966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.059118 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.059258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.059420 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.059560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.059832 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.059961 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.060141 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.060279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.060451 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.060589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.060759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.061043 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.061188 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.061332 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.061462 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.061595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.061732 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.061889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.062077 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.062301 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.062433 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.062560 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.062706 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.062858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.063031 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.063170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.063334 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.063473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.063644 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.063780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.063956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.064086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.064265 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.064403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.064580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.064713 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.064883 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.064986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.065205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.065311 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.065524 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.065636 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.065839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.065938 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.066149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.066245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.066486 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.066604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.066838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.066972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.067151 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.067351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.067500 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.067641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.067776 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.067910 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.068086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.068222 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.068391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.068538 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.068699 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.068838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.069001 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.069139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.069351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.069482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.069608 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.069734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.069898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.070030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.070211 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.070341 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.070519 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.070684 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.070851 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.070975 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.071250 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.071380 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.071507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.071634 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.071769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.071900 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.072036 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.072164 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.072348 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.072492 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.072719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.072858 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.072994 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.073129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.073255 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.073382 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.073557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.073704 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.073879 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.074008 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.074184 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.074323 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.074487 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.074626 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.074818 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.074942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.075122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.075256 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.075460 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.075603 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.075763 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.075908 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.076070 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.076198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.076379 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.076519 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.076708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.076846 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.077020 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.077148 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.077346 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.077496 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.077696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.077842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.078008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.078144 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.078332 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.078471 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.078665 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.078808 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.078981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.079522 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.079653 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.079790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.079928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.080065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.080209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.080353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.080482 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.080617 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.080745 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.080883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.081021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.081325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.081467 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.081603 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.081744 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.081873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082009 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082148 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082286 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082424 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082721 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.082858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.083102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.083229 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.083363 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.083499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.083636 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.083765 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.083892 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.084019 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.084160 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.084295 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.084436 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.084982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.085121 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.085251 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.085397 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.085526 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.085663 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.085796 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.085931 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.086060 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.086191 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.086329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.086466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.086593 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.086773 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.086893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.087034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.087179 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.087324 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.087453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.087587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.087722 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.087877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.088022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.088200 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.088333 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.088523 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.088656 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.088839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.088977 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.089158 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.089289 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.089477 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.089615 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.089802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.090003 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.090142 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.090335 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.090468 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.090668 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.090821 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.090987 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.091120 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.091394 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.091532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.091674 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.091803 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.091934 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.092069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.092198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.092326 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.092489 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.092630 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.092797 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.092922 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.093135 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.093277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.093493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.093627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.093813 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.093953 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.094137 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.094283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.094470 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.094611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.094842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.094980 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.095127 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.095378 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.095510 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.095701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.095832 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.096041 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.096172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.096372 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.096504 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.096683 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.096822 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.097000 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.097140 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.097314 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.097449 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.097625 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.097759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.097935 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.098076 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.098242 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.098380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.098555 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.098739 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.098882 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.099019 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.099197 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.099336 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.099504 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.099633 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.099818 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.099950 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.100123 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.100252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.100447 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.100598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.100826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.100969 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.101099 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.101294 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.101565 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.101703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.101840 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.101969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.102097 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.102279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.102502 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.102634 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.102842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.102986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.103174 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.103305 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.103498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.103642 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.103821 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.103951 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.104136 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.104274 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.104450 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.104590 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.104781 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.104910 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.105083 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.105214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.105387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.105530 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.105701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.105830 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.106007 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.106222 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.106361 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.106490 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.106617 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.106801 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.106931 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.107058 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.107235 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.107371 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.107552 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.107691 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.107856 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.107985 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.108191 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.108373 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.108504 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.108737 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.108886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.109460 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.109627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.109627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.109888 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.110025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.110155 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.110298 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.110436 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.110565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.110734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.110865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.111023 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.111161 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.111299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.111299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.111666 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.111807 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.111942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.112087 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.112225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.112361 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.112499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.112631 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.112750 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.112874 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113286 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113414 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113551 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113679 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.113942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.114076 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.114204 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.114339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.114467 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.114598 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.114788 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.114969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.115101 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.115292 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.115433 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.115630 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.115832 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.115963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.116173 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.116316 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.116499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.116639 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.116813 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.116941 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.117117 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.117248 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.117433 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.117563 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.117736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.117875 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.118048 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.118179 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.118351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.118482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.118682 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.118816 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.119010 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.119149 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.119328 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.119460 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.119641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.119764 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.119947 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.120071 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.120266 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.120395 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.120632 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.120788 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.120928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.121061 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.121190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.121315 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.121491 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.121767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.121905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.122032 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.122167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.122303 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.122431 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.122669 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.122805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.123006 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.123138 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.123323 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.123467 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.123654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.123785 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.123989 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.124134 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.124302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.124485 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.124679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.124819 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.124999 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.125132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.125315 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.125449 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.125639 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.125778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.125974 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.126108 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.126284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.126422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.126596 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.126760 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.127026 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.127170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.127337 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.127469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.127648 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.127787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.127959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.128099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.128267 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.128398 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.128576 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.128714 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.128887 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.129032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.129194 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.129351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.129506 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.129638 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.129821 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.129959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.130147 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.130277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.130467 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.130598 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.130802 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.130949 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.131118 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.131249 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.131428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.131558 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.131827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.131979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.132109 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.132235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.132365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.132500 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.132646 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.132783 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.132932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.133066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.133244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.133381 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.133549 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.133687 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.133860 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.134003 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.134169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.134300 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.134483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.134625 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.134827 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.134959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.135140 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.135286 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.135454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.135596 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.135764 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.135895 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.136074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.136213 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.136382 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.136522 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.136689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.136812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.136996 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.137193 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.137316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.137435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.137603 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.137735 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.137912 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.138056 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.138223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.138353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.138530 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.138710 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.138859 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.138987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.139145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.139275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.139462 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.139593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.139773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.139911 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.140100 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.140232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.140410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.140558 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.140719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.140837 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.141021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.141139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.141324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.141463 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.141628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.141770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.142051 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.142192 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.142320 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.142464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.142602 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.142754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.142883 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143010 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143176 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143313 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143442 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143694 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143830 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.143981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.144126 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.144289 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.144420 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.144590 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.144721 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.144890 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.145031 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.145190 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.145358 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.145488 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.145665 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.145798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.145996 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.146137 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.146322 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.146454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.146736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.146894 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.147032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.147160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.147285 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.147421 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.147618 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.147757 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.147933 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.148075 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.148248 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.148377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.148567 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.148697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.148879 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.149007 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.149186 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.149317 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.149847 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.149987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.150161 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.150301 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.150473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.150605 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.150803 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.150935 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.151112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.151252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.151419 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.151563 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.151726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.151861 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.152654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.152796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.152925 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153070 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153200 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153711 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153847 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.153975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.154142 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.154282 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.154419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117066) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 01 10:03:20.154563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.154563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.154841 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.155073 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.155385 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.156259 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.156259 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.156542 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.156668 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.156955 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.157278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.157600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.157924 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.158266 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.158578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.158941 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.159267 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.159580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.159886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.160182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Apr 01 10:03:20.160426 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117065) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Apr 01 10:03:20.177390 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_db.sqlalchemy.engines [None req-75e9e013-256a-4220-a315-115d988cb288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.183199 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.241919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.context [None req-75e9e013-256a-4220-a315-115d988cb288 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99e219f2-f124-4025-bb90-a3ae1910c4c9(cell1) {{(pid=117066) load_cells /opt/stack/nova/nova/context.py:464}} Apr 01 10:03:20.245736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.context [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),99e219f2-f124-4025-bb90-a3ae1910c4c9(cell1) {{(pid=117065) load_cells /opt/stack/nova/nova/context.py:464}} Apr 01 10:03:20.246505 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-75e9e013-256a-4220-a315-115d988cb288 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:03:20.248159 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-75e9e013-256a-4220-a315-115d988cb288 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:03:20.248972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-75e9e013-256a-4220-a315-115d988cb288 None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:03:20.250072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:03:20.251042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-75e9e013-256a-4220-a315-115d988cb288 None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:03:20.251631 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:03:20.252429 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:03:20.254351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:03:20.262152 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_db.sqlalchemy.engines [None req-75e9e013-256a-4220-a315-115d988cb288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.264434 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_db.sqlalchemy.engines [None req-75e9e013-256a-4220-a315-115d988cb288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.266353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.268108 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.423259 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_db.sqlalchemy.engines [None req-75e9e013-256a-4220-a315-115d988cb288 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117066) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.425936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_db.sqlalchemy.engines [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117065) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Apr 01 10:03:20.862569 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: WARNING keystonemiddleware.auth_token [None req-75e9e013-256a-4220-a315-115d988cb288 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 10:03:20.865360 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: WARNING keystonemiddleware.auth_token [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 10:03:20.869074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: WARNING keystonemiddleware.auth_token [None req-75e9e013-256a-4220-a315-115d988cb288 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 10:03:20.871995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: WARNING keystonemiddleware.auth_token [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 10:03:21.090549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: WARNING keystonemiddleware.auth_token [None req-75e9e013-256a-4220-a315-115d988cb288 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 10:03:21.095474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: WARNING keystonemiddleware.auth_token [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 01 10:03:21.096409 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: WARNING keystonemiddleware.auth_token [None req-75e9e013-256a-4220-a315-115d988cb288 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 10:03:21.101124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: WARNING keystonemiddleware.auth_token [None req-6bd5a370-5bfd-4fef-b78d-2a59109fa14b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 01 10:03:21.101876 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfbbdb89c0 pid: 117066 (default app) Apr 01 10:03:21.106619 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfbbdb89c0 pid: 117065 (default app) Apr 01 10:04:01.127269 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b99dd3c4-f854-4ca9-b5a4-94382e1ce174 tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Action: 'create', calling method: .version_select at 0x7f64ef872790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1228112105", "metadata": {"Type": "work"}}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:01.358106 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-750661187", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "networks": [{"uuid": "cdaaa488-4111-4492-9af3-e5548f6482b2"}]}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:02.396637 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] validate_networks() for [('cdaaa488-4111-4492-9af3-e5548f6482b2', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:04:03.524100 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b99dd3c4-f854-4ca9-b5a4-94382e1ce174 tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.795254 Apr 01 10:04:03.524850 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 1 10:03:59 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3799 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 01 10:04:03.539141 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a04c19cb-d5ff-4a99-a8c5-27ebce30cfe8 tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Calling method '.version_select at 0x7f64ef73f790>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:03.750973 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a04c19cb-d5ff-4a99-a8c5-27ebce30cfe8 tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc" status: 200 len: 353 microversion: 2.1 time: 0.217369 Apr 01 10:04:03.752391 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 2/2] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:04:03 2022] GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc => generated 353 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:04.768042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8a53d46e-7dad-4b09-bd7c-addac3f2a55d tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Calling method '.version_select at 0x7f64ef73f9d0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:04.875285 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8a53d46e-7dad-4b09-bd7c-addac3f2a55d tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc" status: 200 len: 354 microversion: 2.1 time: 0.111261 Apr 01 10:04:04.875855 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 3/3] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:04:04 2022] GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:04.888668 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-afdb1e8f-942b-468f-bbc6-cb9ebb70f35e tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Calling method '.version_select at 0x7f64ef73fee0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:04.997349 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-afdb1e8f-942b-468f-bbc6-cb9ebb70f35e tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc" status: 200 len: 354 microversion: 2.1 time: 0.113202 Apr 01 10:04:04.998092 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 4/4] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:04:04 2022] GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc => generated 354 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:05.014011 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f3e4a1a5-c464-4406-a505-ee238b43b155 tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Calling method '.version_select at 0x7f64ef7555e0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:05.156799 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f3e4a1a5-c464-4406-a505-ee238b43b155 tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc" status: 202 len: 0 microversion: 2.1 time: 0.146022 Apr 01 10:04:05.158211 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 5/5] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:04:05 2022] DELETE /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc => generated 0 bytes in 148 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 01 10:04:05.167372 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ed9d1697-83c6-4d8f-8418-7b8f7a1beebd tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Calling method '.version_select at 0x7f64ef73fc10>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:05.255078 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ed9d1697-83c6-4d8f-8418-7b8f7a1beebd tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc" status: 200 len: 353 microversion: 2.1 time: 0.092215 Apr 01 10:04:05.256326 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 6/6] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:04:05 2022] GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc => generated 353 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:04:05.589463 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:04:05.590008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:04:05.590377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:04:05.590812 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:04:05.591226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:04:05.621066 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:05.621761 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:05.623562 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:05.624789 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:05.709756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Getting quotas for project a3b3649989d44826a64e8a7ee24dbf90. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:05.722205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Getting quotas for user dd3b377ae39b4f2387db5fb30716aff3 and project a3b3649989d44826a64e8a7ee24dbf90. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:05.744323 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:04:05.748462 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:04:05.929942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f735ba38-bac1-48e3-82bc-c26c9a9c2400 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.846971 Apr 01 10:04:05.941951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 1/7] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:04:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 5861 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:04:05.951161 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-70a77ee1-fbb6-40ed-906c-d10535ee553c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:05.951976 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-70a77ee1-fbb6-40ed-906c-d10535ee553c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:06.269115 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7a946fd3-3f6b-43b5-a077-53f1979e0dae tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Calling method '.version_select at 0x7f64eee785e0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:06.391575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-7a946fd3-3f6b-43b5-a077-53f1979e0dae tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] HTTP exception thrown: Volume 70703d67-3463-4a91-aa0b-40cedafb8ccc could not be found. Apr 01 10:04:06.392191 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7a946fd3-3f6b-43b5-a077-53f1979e0dae tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] Returning 404 to user: Volume 70703d67-3463-4a91-aa0b-40cedafb8ccc could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:04:06.393044 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7a946fd3-3f6b-43b5-a077-53f1979e0dae tempest-VolumesGetTestJSON-195490106 tempest-VolumesGetTestJSON-195490106-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc" status: 404 len: 109 microversion: 2.1 time: 0.128705 Apr 01 10:04:06.393594 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 2/8] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:04:06 2022] GET /compute/v2.1/os-volumes/70703d67-3463-4a91-aa0b-40cedafb8ccc => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 01 10:04:06.512807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-70a77ee1-fbb6-40ed-906c-d10535ee553c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:06.530789 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-70a77ee1-fbb6-40ed-906c-d10535ee553c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1214 microversion: 2.1 time: 0.587106 Apr 01 10:04:06.545767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 7/9] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:05 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1214 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:07.555054 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-98ce3af4-31c5-48a3-ac6f-dd45965a080b tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:07.555688 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-98ce3af4-31c5-48a3-ac6f-dd45965a080b tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:08.284477 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-98ce3af4-31c5-48a3-ac6f-dd45965a080b tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:08.308146 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-98ce3af4-31c5-48a3-ac6f-dd45965a080b tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1214 microversion: 2.1 time: 0.758461 Apr 01 10:04:08.309203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 3/10] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:07 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1214 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:09.326352 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:09.327048 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:09.344542 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:09.345053 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:09.349354 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:09.349778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:10.150352 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:10.185787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b60315be-63e0-44f4-866f-a19a8db1ae70 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1272 microversion: 2.1 time: 0.864087 Apr 01 10:04:10.187825 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 8/11] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:09 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1272 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:11.207309 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:11.208947 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:11.224579 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:11.233137 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:11.237020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:11.240582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:11.957031 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:11.979231 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-90b85e96-a2ec-4302-98ab-3f18e52fedd8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1272 microversion: 2.1 time: 0.779549 Apr 01 10:04:11.986860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 4/12] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:11 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1272 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:13.015041 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:13.018746 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:13.044537 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:13.053576 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:13.054435 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:13.057896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:13.898869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:13.913851 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b5b5f583-2de9-4be3-ba8b-e5d45e693bd7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.914585 Apr 01 10:04:13.916095 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 9/13] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:12 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:14.931895 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:14.932610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:14.941601 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:14.948429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:14.949443 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:14.949890 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:15.269127 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:15.279229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8d57370f-1243-4dc9-afce-b14f0f489171 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.350860 Apr 01 10:04:15.299471 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 10/14] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:14 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:15.879202 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f20ddc19-f0d1-401c-bdde-7231fd13752d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'create', calling method: .version_select at 0x7f64ee58faf0>, body: {"keypair": {"name": "tempest-keypair-870983360"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:15.942600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-f20ddc19-f0d1-401c-bdde-7231fd13752d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:15.952574 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-f20ddc19-f0d1-401c-bdde-7231fd13752d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for user d6cc94b4e59c4b3ba507cc2e696e1a37 and project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:16.700465 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-764064554", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:16.854494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-f20ddc19-f0d1-401c-bdde-7231fd13752d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:16.863842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-f20ddc19-f0d1-401c-bdde-7231fd13752d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for user d6cc94b4e59c4b3ba507cc2e696e1a37 and project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:16.900095 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f20ddc19-f0d1-401c-bdde-7231fd13752d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 2.542898 Apr 01 10:04:16.908442 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 5/15] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:04:14 2022] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 2554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:16.918990 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:16.919827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:16.945299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:16.946022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:16.947510 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:16.954999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:17.039607 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] validate_networks() for [('842ae9ac-afe6-4c7c-bd19-1175b1f98e37', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:04:18.160093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:18.170079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f63ea773-f639-4d48-87e1-2132f119fce9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 1.260369 Apr 01 10:04:18.188130 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 6/16] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:16 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 1279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:18.855677 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-90558f6d-c1a7-4ab9-ac96-294023aad965 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'create', calling method: .version_select at 0x7f64ee4f2940>, body: {"keypair": {"name": "tempest-keypair-587481964"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:18.900014 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-90558f6d-c1a7-4ab9-ac96-294023aad965 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:18.955633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-90558f6d-c1a7-4ab9-ac96-294023aad965 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for user a0661916b4064097a834dcef7e02b3ee and project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:19.710119 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-90558f6d-c1a7-4ab9-ac96-294023aad965 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:19.723048 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-90558f6d-c1a7-4ab9-ac96-294023aad965 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for user a0661916b4064097a834dcef7e02b3ee and project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:19.764485 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-90558f6d-c1a7-4ab9-ac96-294023aad965 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 1.459122 Apr 01 10:04:19.768283 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 7/17] 10.222.0.46 () {62 vars in 1198 bytes} [Fri Apr 1 10:04:18 2022] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 1465 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 01 10:04:19.782477 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:19.786074 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:19.803529 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:19.806841 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:19.808221 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:19.810871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:20.894435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:20.907424 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b190afd6-f7ac-4e16-aa61-103f6b371711 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 1.137192 Apr 01 10:04:20.909379 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 8/18] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:19 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 1140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:21.029244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-598a15d3-f913-494d-b939-cc16dd4d6a1a req-b376c670-d464-4b32-9de7-d595f5100252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce347c63-a71c-42d4-9c03-03c4d28f515b", "tag": "f3e53471-0d0b-47a5-8d97-64f53ef18e1e"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:21.057213 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-598a15d3-f913-494d-b939-cc16dd4d6a1a req-b376c670-d464-4b32-9de7-d595f5100252 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:21.057665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-598a15d3-f913-494d-b939-cc16dd4d6a1a req-b376c670-d464-4b32-9de7-d595f5100252 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:21.690971 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-598a15d3-f913-494d-b939-cc16dd4d6a1a req-b376c670-d464-4b32-9de7-d595f5100252 service nova] Creating event network-changed:f3e53471-0d0b-47a5-8d97-64f53ef18e1e for instance ce347c63-a71c-42d4-9c03-03c4d28f515b on hv-cinder-maste Apr 01 10:04:21.691520 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-598a15d3-f913-494d-b939-cc16dd4d6a1a req-b376c670-d464-4b32-9de7-d595f5100252 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 01 10:04:21.695644 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c6e29414-6aa1-4e66-bfd7-38f68ea0c00e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:21.708080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c6e29414-6aa1-4e66-bfd7-38f68ea0c00e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:21.720929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c6e29414-6aa1-4e66-bfd7-38f68ea0c00e None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:21.721895 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c6e29414-6aa1-4e66-bfd7-38f68ea0c00e None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:21.756932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.compute.rpcapi [None req-c6e29414-6aa1-4e66-bfd7-38f68ea0c00e None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 01 10:04:21.769917 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c6e29414-6aa1-4e66-bfd7-38f68ea0c00e None None] Releasing lock "compute-rpcapi-router" {{(pid=117065) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 01 10:04:21.806935 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c6e29414-6aa1-4e66-bfd7-38f68ea0c00e None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.894017 Apr 01 10:04:21.808009 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 9/19] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:21.925893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:21.927444 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:21.940165 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:21.946029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:21.950953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:21.952868 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:22.296331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:04:22.297513 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:04:22.298431 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:04:22.299131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:04:22.300102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:04:22.367935 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:22.376806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:22.379099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:22.383277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:22.558804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for project 4073e831952c461bb6bb0e6b1137240b. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:22.583370 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for user 3ca94cdcf3824f56a886b757e41602dd and project 4073e831952c461bb6bb0e6b1137240b. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:22.632963 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:04:22.651275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:04:22.903897 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-14610c27-63a9-4be9-aff4-ff7095dfa649 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 7.603261 Apr 01 10:04:22.905323 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 11/20] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:04:15 2022] POST /compute/v2.1/servers => generated 383 bytes in 7605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:04:22.919504 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-97ddc874-6951-4964-bf7c-2c4cd8683115 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:22.920563 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-97ddc874-6951-4964-bf7c-2c4cd8683115 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:23.189090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:23.198428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b99d4f43-6740-425c-82ce-2e6bae756270 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 1.276685 Apr 01 10:04:23.203722 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 10/21] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:21 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 1283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:23.255603 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1052532519", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b577230f-3445-4ece-839d-d9c1aac044c2"}], "security_groups": [{"name": "tempest-securitygroup--1071368833"}], "key_name": "tempest-keypair-870983360", "user_data": "}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:23.587625 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] validate_networks() for [('b577230f-3445-4ece-839d-d9c1aac044c2', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:04:23.618030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-97ddc874-6951-4964-bf7c-2c4cd8683115 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:23.673280 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-97ddc874-6951-4964-bf7c-2c4cd8683115 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1221 microversion: 2.1 time: 0.760827 Apr 01 10:04:23.686683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 12/22] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:22 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1221 bytes in 769 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:23.892300 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-29490837", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:24.311678 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] validate_networks() for [('842ae9ac-afe6-4c7c-bd19-1175b1f98e37', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:04:24.628553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:04:24.629182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:04:24.629658 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:04:24.630146 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:04:24.630563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:04:24.643481 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:24.644102 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:24.645844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:24.646459 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:24.673950 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for project 8abd12555c7642749049eaaedec0cbc1. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:24.680487 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for user d6cc94b4e59c4b3ba507cc2e696e1a37 and project 8abd12555c7642749049eaaedec0cbc1. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:24.725131 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:04:24.735001 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:04:24.838928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c03b146d-82d9-4a9c-bae7-3aae39c74485 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.606696 Apr 01 10:04:24.844985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 11/23] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:04:23 2022] POST /compute/v2.1/servers => generated 402 bytes in 1613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:04:24.859171 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:24.861294 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:24.872268 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:24.873049 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:24.875026 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:24.875628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:25.220082 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:25.231797 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7ea1bd89-9374-449e-ac67-6cb19a3355d4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.383807 Apr 01 10:04:25.232630 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 12/24] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:24 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:25.248378 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-331be3a1-b9eb-4b0b-8339-83a90a434298 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:25.249756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-331be3a1-b9eb-4b0b-8339-83a90a434298 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:25.403161 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-331be3a1-b9eb-4b0b-8339-83a90a434298 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:25.411858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-331be3a1-b9eb-4b0b-8339-83a90a434298 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1237 microversion: 2.1 time: 0.167477 Apr 01 10:04:25.412873 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 13/25] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:25 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1237 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:25.447065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:04:25.448184 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:04:25.448894 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:04:25.449505 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:04:25.450150 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:04:25.471466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:25.474883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:25.475988 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:25.476742 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:25.517533 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for project 4073e831952c461bb6bb0e6b1137240b. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:25.533561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for user 3ca94cdcf3824f56a886b757e41602dd and project 4073e831952c461bb6bb0e6b1137240b. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:25.569154 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:04:25.590246 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:04:25.738785 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-89dd022d-6f4a-499c-b8f9-e05887747ff3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.850860 Apr 01 10:04:25.747166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 13/26] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:04:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 1859 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:04:25.756899 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2512efd9-bc3c-42b2-8eeb-26ba23d768c0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:25.758304 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2512efd9-bc3c-42b2-8eeb-26ba23d768c0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:25.880790 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2512efd9-bc3c-42b2-8eeb-26ba23d768c0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:25.905988 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2512efd9-bc3c-42b2-8eeb-26ba23d768c0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1220 microversion: 2.1 time: 0.142442 Apr 01 10:04:25.907074 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 14/27] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:25 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1220 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:26.231793 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2128667267", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e9d4a0c-1d37-47c8-938f-aa4da0ee4052"}], "security_groups": [{"name": "tempest-securitygroup--1086056627"}], "key_name": "tempest-keypair-587481964", "user_data": "}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:26.250566 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:26.251528 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:26.272069 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:26.272542 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:26.276288 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:26.276885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:26.505371 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] validate_networks() for [('2e9d4a0c-1d37-47c8-938f-aa4da0ee4052', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:04:26.674851 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:26.703788 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-077d9dd2-3401-4577-9766-b35876b7e627 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.458039 Apr 01 10:04:26.704953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 15/28] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:26 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:26.721883 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:26.728788 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:26.764857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:26.765510 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:26.766128 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:26.766567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:26.964012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:26.975053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3bace848-4a69-4d24-8aa2-426550a7f880 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1241 microversion: 2.1 time: 0.268594 Apr 01 10:04:26.976825 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 16/29] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:26 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1241 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:26.995240 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:26.996537 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:27.024027 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:27.024499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:27.032966 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:27.033433 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:27.186983 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:27.206971 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9aeb2afb-92a1-496a-94d9-43ac6cbabe2e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1224 microversion: 2.1 time: 0.222894 Apr 01 10:04:27.211442 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 17/30] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:26 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1224 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:27.661428 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:04:27.661986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:04:27.662594 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:04:27.663064 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:04:27.663461 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:04:27.674810 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:27.675441 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:27.676304 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:27.676939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:27.705516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for project 984d4a492510482d88f7aec954117969. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:04:27.710167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for user a0661916b4064097a834dcef7e02b3ee and project 984d4a492510482d88f7aec954117969. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:04:27.722333 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:27.723475 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:27.725881 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:04:27.729856 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:04:27.734978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:27.735554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:27.736447 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:27.736995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:27.794460 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7515e491-9769-4b84-a438-867510e1e9e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.568346 Apr 01 10:04:27.795623 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 14/31] 10.222.0.46 () {62 vars in 1187 bytes} [Fri Apr 1 10:04:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 1570 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 01 10:04:27.806800 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c6b6aa0d-d4a7-49ff-92e5-c65c9ffa269e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:27.807697 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c6b6aa0d-d4a7-49ff-92e5-c65c9ffa269e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:27.938261 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c6b6aa0d-d4a7-49ff-92e5-c65c9ffa269e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:27.950792 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c6b6aa0d-d4a7-49ff-92e5-c65c9ffa269e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:27.958519 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c6b6aa0d-d4a7-49ff-92e5-c65c9ffa269e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:27.959932 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c6b6aa0d-d4a7-49ff-92e5-c65c9ffa269e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1281 microversion: 2.20 time: 0.157142 Apr 01 10:04:27.970689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 15/32] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:27 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1281 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:27.990301 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:27.998705 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:27.999734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d2fc5d3a-6fae-44aa-852b-cee39486672d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.280973 Apr 01 10:04:28.000510 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:28.011958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 18/33] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:27 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:28.015941 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:28.019085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:28.020114 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:28.022839 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:28.101299 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:28.114552 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b086a680-5c8e-4410-a963-e94c7a284ce1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1241 microversion: 2.1 time: 0.124886 Apr 01 10:04:28.115517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 16/34] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:27 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1241 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:28.228818 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:28.229864 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:28.242822 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:28.244263 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:28.246283 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:28.249499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:28.354272 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:28.363428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-271c20fd-2cb6-448e-a843-94b5b46e2cc1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1224 microversion: 2.1 time: 0.138892 Apr 01 10:04:28.375830 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 19/35] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:28 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1224 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:28.983070 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:28.984411 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:28.992650 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:28.993400 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:28.994428 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:28.994898 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:29.019719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:29.020422 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:29.053657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:29.054302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:29.057795 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:29.058603 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:29.068282 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:29.084870 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:29.086387 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:29.087596 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-de42a362-1457-4e60-8e31-57273753f29d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1285 microversion: 2.20 time: 0.113068 Apr 01 10:04:29.088168 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 17/36] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:28 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:29.140099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:29.140714 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:29.150616 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:29.151414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:29.152475 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:29.153098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:29.287620 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:29.295852 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f5e40758-06c7-4ef8-b884-15c4b7d2f5f6 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.280888 Apr 01 10:04:29.296447 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 20/37] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:29 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:29.311301 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:29.319932 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2291a4b7-7137-492a-ae80-9e005488d435 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1241 microversion: 2.1 time: 0.184288 Apr 01 10:04:29.322700 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 18/38] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:29 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1241 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:29.381613 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:29.382226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:29.389952 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:29.390400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:29.391440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:29.391851 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:29.461858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:29.473190 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f0d728e4-36b2-4b8e-9a20-16f66093b1d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1224 microversion: 2.1 time: 0.095214 Apr 01 10:04:29.474201 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 21/39] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:29 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1224 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:30.106639 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:30.107345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:30.115805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.116021 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.116747 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.117164 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.195954 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:30.207916 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:30.210987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:30.212481 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-79129b01-7122-4f31-ad98-a355368e67e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1285 microversion: 2.20 time: 0.110726 Apr 01 10:04:30.213650 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 19/40] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:30 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:30.315776 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:30.320446 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:30.327290 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.327758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.337652 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:30.338270 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:30.346865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.347523 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.354224 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.355829 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.356942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.358853 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.548511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:30.565722 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c0fc1ebd-ebea-45c6-bd94-e05ea686f3d8 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1241 microversion: 2.1 time: 0.228972 Apr 01 10:04:30.566631 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 20/41] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:30 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1241 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:30.580162 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:30.585738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:30.608430 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.611442 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.617524 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:30.618230 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:30.655142 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:30.663740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0ca5abad-968d-48ab-9beb-ca7cc851fd17 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.354465 Apr 01 10:04:30.664332 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 22/42] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:30 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:30.749072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:30.757905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-da410a4d-ef22-4c50-8208-a9965d397816 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1272 microversion: 2.1 time: 0.187978 Apr 01 10:04:30.759329 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 21/43] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:30 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1272 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:31.254719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:31.255313 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:31.262430 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.262905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:31.264278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.264764 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:31.415835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:31.426308 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:31.440842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:31.442095 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8f6633d4-1b25-45ad-8d95-ff615ee34a6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1351 microversion: 2.20 time: 0.192480 Apr 01 10:04:31.442714 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 23/44] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:31 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1351 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:31.584767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:31.585619 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:31.598337 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.598834 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:31.600022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.600740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:31.681423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:31.682275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:31.705322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.708940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:31.713478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.714342 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:31.838560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:31.858342 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-715875c2-2636-442f-bea4-35f652a3a1b3 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1297 microversion: 2.1 time: 0.279327 Apr 01 10:04:31.879014 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 22/45] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:31 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1297 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:31.886082 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:31.886730 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:31.906100 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.906563 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:31.908883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:31.909330 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:32.108725 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:32.125452 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-303f8b80-57d7-4d6b-800a-6239e15c4b59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1278 microversion: 2.1 time: 0.245201 Apr 01 10:04:32.137733 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 23/46] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:31 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1278 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:32.462325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:32.463046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:32.485116 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:32.486814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:32.487902 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:32.488960 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:32.594847 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:32.606591 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:32.610096 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:32.611989 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:32.613199 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9bcd9a9c-f05b-4148-bf8d-7bb4554d6030 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1339 microversion: 2.20 time: 0.156218 Apr 01 10:04:32.614122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7e6fcdc6-87f5-4594-8463-20321bb83bf8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.937465 Apr 01 10:04:32.623016 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 24/48] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:31 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 947 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:32.627896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 24/48] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:32 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1339 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:32.885573 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:32.886460 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:32.892584 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:32.893036 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:32.893800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:32.894229 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:33.003151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:33.011306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cb9a6148-156e-4724-a7de-84d23f13ed59 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1295 microversion: 2.1 time: 0.129801 Apr 01 10:04:33.012372 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 25/49] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:32 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1295 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:33.143483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:33.144392 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:33.150947 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:33.151477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:33.152306 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:33.152716 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:33.426388 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:33.437887 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f5b1632a-997d-4382-a31e-693f72b42f13 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 0.297971 Apr 01 10:04:33.438877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 25/50] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:33 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:33.631566 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:33.632176 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:33.643387 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:33.643921 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:33.655191 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:33.655640 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:33.657641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:33.658155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:33.658964 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:33.660827 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:33.667346 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:33.668802 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.129948 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:34.138542 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:34.145061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:34.149992 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1dd7b772-c933-4832-810d-1f98a5ad7f54 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.510228 Apr 01 10:04:34.166464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:33 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:04:34.172169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:34.181202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:34.193925 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:34.194564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.195560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:34.195997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.447284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:34.475410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-89c0858c-f139-40d4-92d7-77d598845dc1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.844321 Apr 01 10:04:34.476997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 26/52] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:33 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:34.484455 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:34.485562 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:34.500510 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:34.501133 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.502255 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:34.503336 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.552289 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:34.564530 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7b884c62-80cd-46bd-8c1f-bd2a90833026 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.396587 Apr 01 10:04:34.565483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 27/53] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:34 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:34.605912 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-29d8fbaf-2d72-483d-b586-d0dce5e2f335 req-a6695726-697d-49e2-84a7-aa452503a45b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04f542a5-3483-4eb2-8469-e930b23ca65f", "tag": "e9a85c98-ea8f-41f5-9d37-da82f3c446c0"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:34.632462 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-29d8fbaf-2d72-483d-b586-d0dce5e2f335 req-a6695726-697d-49e2-84a7-aa452503a45b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:34.632930 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-29d8fbaf-2d72-483d-b586-d0dce5e2f335 req-a6695726-697d-49e2-84a7-aa452503a45b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.730840 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-29d8fbaf-2d72-483d-b586-d0dce5e2f335 req-a6695726-697d-49e2-84a7-aa452503a45b service nova] Creating event network-changed:e9a85c98-ea8f-41f5-9d37-da82f3c446c0 for instance 04f542a5-3483-4eb2-8469-e930b23ca65f on hv-cinder-maste Apr 01 10:04:34.733909 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-29d8fbaf-2d72-483d-b586-d0dce5e2f335 req-a6695726-697d-49e2-84a7-aa452503a45b service nova] Acquired lock "compute-rpcapi-router" {{(pid=117066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Apr 01 10:04:34.736587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3da255c2-dc18-421f-b51d-62a3814f665b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:34.737032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3da255c2-dc18-421f-b51d-62a3814f665b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.737839 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3da255c2-dc18-421f-b51d-62a3814f665b None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:34.738267 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3da255c2-dc18-421f-b51d-62a3814f665b None None] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:34.781046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.compute.rpcapi [None req-3da255c2-dc18-421f-b51d-62a3814f665b None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Apr 01 10:04:34.787655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3da255c2-dc18-421f-b51d-62a3814f665b None None] Releasing lock "compute-rpcapi-router" {{(pid=117066) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 01 10:04:34.833338 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3da255c2-dc18-421f-b51d-62a3814f665b None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.231580 Apr 01 10:04:34.834209 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 28/54] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:04:35.175066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:35.175786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:35.188759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:35.189218 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:35.190021 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:35.199934 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:35.665700 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:35.675813 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:35.689927 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:35.691473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-58d96460-2ea2-4eab-b588-af6225a019e4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.521235 Apr 01 10:04:35.692077 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 29/55] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:35 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:35.714879 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:35.716443 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:35.727699 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:35.731838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:35.733516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:35.734189 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:35.943929 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:35.962659 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b307055d-7654-42c0-903f-8f53db93d347 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.259549 Apr 01 10:04:35.964304 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 30/56] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:35 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:35.973951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:35.982672 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:35.986338 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:35.989994 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e6988dee-28c9-4f97-aa6f-2808a5b95a5d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 1.511431 Apr 01 10:04:35.999435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 27/57] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:34 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 1513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:35.999625 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:35.999625 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:35.999625 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:35.999625 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:36.253197 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:36.263513 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-87931f5c-89a0-4c22-86f5-49db92992ab2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.284296 Apr 01 10:04:36.264593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 31/58] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:35 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:36.710853 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:36.711466 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:36.729996 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:36.731641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:36.734537 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:36.736228 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:36.984467 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:36.985710 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:36.992283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:36.993059 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:36.994012 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:36.994585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:37.422034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:37.430408 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-874c6b2e-0a16-4b93-a0d6-13f2c536a8e8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.452965 Apr 01 10:04:37.436010 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 32/59] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:36 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:37.447743 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:37.450763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:37.488489 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:37.490511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:37.494384 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:37.495607 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:37.734771 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:37.742886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3b82d183-feb9-4323-9e38-9929e9dafd75 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 0.305355 Apr 01 10:04:37.753047 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 33/60] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:37 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:37.759655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:37.760267 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:37.770425 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:37.770777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:37.771712 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:37.772314 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:37.966704 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:37.978482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9343a2df-333c-43d2-8f4a-637119c5d4ef tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.220808 Apr 01 10:04:37.979735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 34/61] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:37 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:38.149351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:38.183453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:38.186602 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:38.189418 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bf6c8142-a0ae-4a93-8176-aaaf57d14350 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 1.483796 Apr 01 10:04:38.190534 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 28/62] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:36 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 1485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:38.375740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-2bacfc5c-1836-4307-8e76-aca7d60a57b0 req-894ab8c3-cbe4-4a8a-9209-f2c5cdcdba15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "acf7fba9-5b94-4c19-8f65-5a3a831b3458", "tag": "7309433f-2298-42e8-bf12-5febdcdd2183"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:38.392357 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-2bacfc5c-1836-4307-8e76-aca7d60a57b0 req-894ab8c3-cbe4-4a8a-9209-f2c5cdcdba15 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:38.393051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-2bacfc5c-1836-4307-8e76-aca7d60a57b0 req-894ab8c3-cbe4-4a8a-9209-f2c5cdcdba15 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:38.434214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-2bacfc5c-1836-4307-8e76-aca7d60a57b0 req-894ab8c3-cbe4-4a8a-9209-f2c5cdcdba15 service nova] Creating event network-changed:7309433f-2298-42e8-bf12-5febdcdd2183 for instance acf7fba9-5b94-4c19-8f65-5a3a831b3458 on hv-cinder-maste Apr 01 10:04:38.442608 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-2bacfc5c-1836-4307-8e76-aca7d60a57b0 req-894ab8c3-cbe4-4a8a-9209-f2c5cdcdba15 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.461312 Apr 01 10:04:38.444077 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 35/63] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:38.453578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:38.454609 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:38.467135 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:38.468311 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:38.470089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:38.471567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:38.813249 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-5c80d552-7985-49c4-bfc9-03e96efead53 req-e0a64f03-3d6c-41a1-8df4-678013afe19d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce347c63-a71c-42d4-9c03-03c4d28f515b", "name": "network-vif-plugged", "status": "completed", "tag": "f3e53471-0d0b-47a5-8d97-64f53ef18e1e"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:38.824595 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5c80d552-7985-49c4-bfc9-03e96efead53 req-e0a64f03-3d6c-41a1-8df4-678013afe19d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:38.825081 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5c80d552-7985-49c4-bfc9-03e96efead53 req-e0a64f03-3d6c-41a1-8df4-678013afe19d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:38.836876 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-5c80d552-7985-49c4-bfc9-03e96efead53 req-e0a64f03-3d6c-41a1-8df4-678013afe19d service nova] Creating event network-vif-plugged:f3e53471-0d0b-47a5-8d97-64f53ef18e1e for instance ce347c63-a71c-42d4-9c03-03c4d28f515b on hv-cinder-maste Apr 01 10:04:38.842119 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-5c80d552-7985-49c4-bfc9-03e96efead53 req-e0a64f03-3d6c-41a1-8df4-678013afe19d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.147137 Apr 01 10:04:38.842806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 36/64] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:38.848929 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:38.849617 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:38.869786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:38.870854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:38.872210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:38.872997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:39.028784 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:39.036982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-23fc4778-f6d7-49b2-aeb3-cf43b2bba1a4 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.589446 Apr 01 10:04:39.041629 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 29/65] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:38 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:39.053982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:39.054792 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:39.069553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:39.070005 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:39.070817 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:39.071251 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:39.233866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:39.253098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f081f5ae-7b8e-4ba5-a945-9740d2e80c0a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 0.408849 Apr 01 10:04:39.254219 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 37/66] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:38 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:39.313057 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:39.316385 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:39.332351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:39.333889 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:39.338882 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:39.342603 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:39.503247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:39.512881 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-87f18f2c-acd4-4b34-90c8-d9993e7860d6 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.470157 Apr 01 10:04:39.518800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 30/67] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:39 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:39.626327 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:39.638358 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:39.644627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:39.645853 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-28adc0bb-29be-48d3-b7d4-b68536c50b9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.364421 Apr 01 10:04:39.646437 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 38/68] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:39 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:40.057459 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:40.058065 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:40.064279 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.064724 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.065480 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.065905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.273622 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:40.274268 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:40.280988 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.281488 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.282316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.282763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.422157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:40.429721 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-91acf6eb-e595-4d36-8f54-6b8bd3463a4b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 0.161178 Apr 01 10:04:40.430318 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 39/69] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:40 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:40.465555 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:40.476112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5f6bcb82-c8c5-49ec-a735-279cdbc2c08d tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.422510 Apr 01 10:04:40.477020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 31/70] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:40 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:40.496903 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-5aa730f0-544e-417b-9f1e-ae1c0c374353 req-4e5879ff-1193-4d7e-b37a-a87f101b08da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fecc8e1-f340-4be9-8243-7369fcf1dbca", "tag": "e35a73e3-6163-462e-9549-4a90aec2d584"}, {"name": "network-changed", "server_uuid": "f0c911a2-ef42-4d2a-bea9-a6c56575559f", "tag": "b8c404b8-1348-40f2-87ab-56e8fc6c155a"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:40.507115 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5aa730f0-544e-417b-9f1e-ae1c0c374353 req-4e5879ff-1193-4d7e-b37a-a87f101b08da service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.507567 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5aa730f0-544e-417b-9f1e-ae1c0c374353 req-4e5879ff-1193-4d7e-b37a-a87f101b08da service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.521378 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-5aa730f0-544e-417b-9f1e-ae1c0c374353 req-4e5879ff-1193-4d7e-b37a-a87f101b08da service nova] Creating event network-changed:e35a73e3-6163-462e-9549-4a90aec2d584 for instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca on hv-cinder-maste Apr 01 10:04:40.521806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-5aa730f0-544e-417b-9f1e-ae1c0c374353 req-4e5879ff-1193-4d7e-b37a-a87f101b08da service nova] Creating event network-changed:b8c404b8-1348-40f2-87ab-56e8fc6c155a for instance f0c911a2-ef42-4d2a-bea9-a6c56575559f on hv-cinder-maste Apr 01 10:04:40.529000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-5aa730f0-544e-417b-9f1e-ae1c0c374353 req-4e5879ff-1193-4d7e-b37a-a87f101b08da service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.037068 Apr 01 10:04:40.530095 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 40/71] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:40 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:40.535958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:40.536634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:40.542844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.543293 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.544080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.544694 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.668979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:40.670374 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:40.677885 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.678331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.679149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:40.679574 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:40.760320 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:40.768023 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-743c1603-98f6-45fb-a5dc-50c8a74ee0a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.236395 Apr 01 10:04:40.768627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 32/72] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:40 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:40.906569 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:40.916685 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:40.918441 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:40.919667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8b527562-8308-42d5-851f-bd675104f63e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.256959 Apr 01 10:04:40.927358 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 41/73] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:40 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:04:41.446720 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:41.447334 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:41.453591 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.454047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:41.454905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.455349 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:41.493804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:41.494515 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:41.501005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.501453 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:41.502215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.502667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:41.637866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:41.645469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-05237fbb-9d9c-4e10-921a-0ffd0afb9759 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1314 microversion: 2.1 time: 0.155780 Apr 01 10:04:41.646018 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 42/74] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:41 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:41.664560 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:41.672578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-41de9c01-b21f-42d5-9780-a33f630bc655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 0.229769 Apr 01 10:04:41.673224 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 33/75] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:41 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:41.789641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:41.790253 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:41.796777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.797226 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:41.798032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.798460 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:41.939220 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:41.940962 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:41.941926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:41.946484 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-032291f7-a71d-4390-b1b9-ea72dc74a971 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.160837 Apr 01 10:04:41.947101 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 43/76] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:41 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:41.950519 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.951152 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:41.952012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:41.952499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:42.146076 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:42.159835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:42.164994 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:42.167182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ab99d277-4942-43ac-a98a-17242f1540db tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.231651 Apr 01 10:04:42.184863 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 34/77] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:41 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:42.353810 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-aff4e0c2-940e-4e26-89f7-7215fe27697c req-e2f7150b-24a1-41ba-ba56-b7366502a00b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f542a5-3483-4eb2-8469-e930b23ca65f", "name": "network-vif-plugged", "status": "completed", "tag": "e9a85c98-ea8f-41f5-9d37-da82f3c446c0"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:42.364635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-aff4e0c2-940e-4e26-89f7-7215fe27697c req-e2f7150b-24a1-41ba-ba56-b7366502a00b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:42.365166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-aff4e0c2-940e-4e26-89f7-7215fe27697c req-e2f7150b-24a1-41ba-ba56-b7366502a00b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:42.380345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-aff4e0c2-940e-4e26-89f7-7215fe27697c req-e2f7150b-24a1-41ba-ba56-b7366502a00b service nova] Creating event network-vif-plugged:e9a85c98-ea8f-41f5-9d37-da82f3c446c0 for instance 04f542a5-3483-4eb2-8469-e930b23ca65f on hv-cinder-maste Apr 01 10:04:42.387681 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-aff4e0c2-940e-4e26-89f7-7215fe27697c req-e2f7150b-24a1-41ba-ba56-b7366502a00b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038135 Apr 01 10:04:42.389259 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 44/78] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:42.662937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:42.663537 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:42.670174 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:42.670825 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:42.671313 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:42.671736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:42.690972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:42.699495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:42.711121 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:42.711688 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:42.712385 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:42.712757 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:42.864392 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:42.872013 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9eee132a-7e22-4e12-af7e-cfc53e099cc7 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1499 microversion: 2.1 time: 0.213084 Apr 01 10:04:42.872603 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 35/79] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:42 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1499 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:42.897226 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:42.906180 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-46cf330b-219b-42c8-9e01-7c2c45df13bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 0.220277 Apr 01 10:04:42.906969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 45/80] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:42 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:42.963785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:42.964399 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:42.970579 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:42.971069 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:42.971845 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:42.972278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:43.119567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:43.128367 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-207f40d8-37a7-46c4-8908-4c1c32a1963f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.168367 Apr 01 10:04:43.128963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 36/81] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:42 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:43.193357 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:43.193966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:43.201865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:43.206898 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:43.207695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:43.211202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:43.406452 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:43.416185 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:43.417524 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:43.421259 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ca4d9939-ac73-43e4-9910-28ba85e39e2f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.231144 Apr 01 10:04:43.435050 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 46/82] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:43 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:43.922322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:43.923731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:43.930171 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:43.930961 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:43.932329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:43.933037 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:44.149225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:44.149729 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:44.154911 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:44.160038 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e209da45-8231-4997-854d-b09bb708f7be tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1320 microversion: 2.1 time: 0.241489 Apr 01 10:04:44.163726 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:44.164381 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:44.164740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 37/83] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:43 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1320 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:44.166034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:44.168346 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:44.394628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-56483bc8-f5dc-43bb-9ed7-4a02a24dc15c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "efcbccd2-0c6a-4d73-bd25-758ad1973a2d"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:44.396114 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-56483bc8-f5dc-43bb-9ed7-4a02a24dc15c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:44.417736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-56483bc8-f5dc-43bb-9ed7-4a02a24dc15c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:44.418982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-56483bc8-f5dc-43bb-9ed7-4a02a24dc15c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:44.423220 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-56483bc8-f5dc-43bb-9ed7-4a02a24dc15c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:44.425846 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-56483bc8-f5dc-43bb-9ed7-4a02a24dc15c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:44.451942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:44.475012 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-644aed83-983c-4a97-978d-adf9c1e60a35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.323277 Apr 01 10:04:44.476176 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 47/84] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:44 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:44.499358 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:44.500264 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:44.518083 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:44.520355 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:44.521376 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:44.522048 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:44.686302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:44.698598 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:44.700716 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:44.702105 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-84be30e1-fcc9-4550-92e1-5c7bbe54a406 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.223410 Apr 01 10:04:44.702952 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 48/85] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:44 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:44.963010 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-56483bc8-f5dc-43bb-9ed7-4a02a24dc15c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "POST /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.571440 Apr 01 10:04:44.963988 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 38/86] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:04:44 2022] POST /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b/os-volume_attachments => generated 194 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:04:45.187646 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:45.189090 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:45.210733 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.211101 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.214508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.215786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.404087 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:45.412199 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-82505a29-b9af-4ac5-a30b-02979bdc34ca tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1514 microversion: 2.1 time: 0.234494 Apr 01 10:04:45.412805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 49/87] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:45 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1514 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:45.430222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:45.431725 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:45.438561 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.439384 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.440391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.442970 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.479350 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lazy-loading 'flavor' on Instance uuid 04f542a5-3483-4eb2-8469-e930b23ca65f {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:04:45.494789 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:45.495180 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:45.501884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.502339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.503377 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.503820 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.621798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-aca27295-fb8c-4a32-9917-248792c7280b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f/action" status: 200 len: 32 microversion: 2.1 time: 0.195665 Apr 01 10:04:45.626550 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 39/88] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:04:45 2022] POST /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:04:45.641965 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:45.642857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:45.662024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.662871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.663866 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.664487 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.696108 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:45.705425 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f70426fc-1fd8-482d-9685-08c4be1c7382 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.216338 Apr 01 10:04:45.706070 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 50/89] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:45 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:45.731979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:45.732820 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:45.748356 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.750130 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:45.750978 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:45.751417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:46.001030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:46.009574 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:46.015571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:46.018504 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-17daf5be-2d43-4b5d-870d-c99ca5c28e1e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.301975 Apr 01 10:04:46.019330 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 51/90] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:45 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:04:46.269974 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:46.278638 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-fc23bf8f-6a78-430e-ae6d-627ff08a181c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.649987 Apr 01 10:04:46.279522 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 40/91] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:45 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:46.724283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:46.724946 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:46.730982 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:46.731416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:46.732218 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:46.732649 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:46.875345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:46.883073 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a2f7f167-7100-467e-a6e0-86aebc84727e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.162913 Apr 01 10:04:46.883652 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 52/92] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:46 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:47.036783 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:47.037388 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:47.043538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:47.043981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:47.044764 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:47.045186 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:47.209967 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:47.218392 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:47.219912 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:47.221020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cdfae1a8-d351-4dfd-b939-7bf0676a2c8c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.188096 Apr 01 10:04:47.221575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 41/93] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:47 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:47.299747 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:47.300814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:47.316927 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:47.318170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:47.319240 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:47.319756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:47.472090 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:47.479723 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f7b80b6f-f50a-4a2c-9a1a-43138c0db251 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.185652 Apr 01 10:04:47.480305 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 53/94] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:47 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:47.900703 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:47.901393 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:47.908374 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:47.908855 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:47.909779 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:47.910209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:48.045227 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:48.052665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-33172e16-f6ca-4394-800c-4473b942cc43 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.156292 Apr 01 10:04:48.053246 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 42/95] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:47 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:48.239362 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:48.240053 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:48.246097 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:48.246611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:48.247546 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:48.248100 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:48.412279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:48.421706 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:48.423928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:48.425241 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f8ec4427-af60-4c7c-9294-7dfb34710293 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.190040 Apr 01 10:04:48.425989 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 54/96] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:48 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:48.497063 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:48.498154 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:48.504287 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:48.504847 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:48.505735 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:48.506304 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:48.651278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:48.659331 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3fe2f128-a3a0-4b9b-9d2d-5f952c680dbd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.166288 Apr 01 10:04:48.660276 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 43/97] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:48 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:49.069783 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:49.070405 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:49.083244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:49.083699 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:49.084573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:49.084904 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:49.228655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:49.236885 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1767f27c-04e3-4409-a146-942930dc532f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.171102 Apr 01 10:04:49.237461 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 55/98] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:49 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:49.443354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:49.448554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:49.456445 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:49.457126 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:49.458241 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:49.458909 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:49.546477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-ddeea380-9053-47ca-a9c0-09c8df7bcb25 req-2e0daf48-471a-4fb4-b0b4-7becc5304d2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c911a2-ef42-4d2a-bea9-a6c56575559f", "name": "network-vif-plugged", "status": "completed", "tag": "b8c404b8-1348-40f2-87ab-56e8fc6c155a"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:49.560560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-ddeea380-9053-47ca-a9c0-09c8df7bcb25 req-2e0daf48-471a-4fb4-b0b4-7becc5304d2d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:49.561422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-ddeea380-9053-47ca-a9c0-09c8df7bcb25 req-2e0daf48-471a-4fb4-b0b4-7becc5304d2d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:49.579098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-ddeea380-9053-47ca-a9c0-09c8df7bcb25 req-2e0daf48-471a-4fb4-b0b4-7becc5304d2d service nova] Creating event network-vif-plugged:b8c404b8-1348-40f2-87ab-56e8fc6c155a for instance f0c911a2-ef42-4d2a-bea9-a6c56575559f on hv-cinder-maste Apr 01 10:04:49.590060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-ddeea380-9053-47ca-a9c0-09c8df7bcb25 req-2e0daf48-471a-4fb4-b0b4-7becc5304d2d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052433 Apr 01 10:04:49.592507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 56/99] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:04:49.678573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:49.679874 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:49.694672 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:49.695355 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:49.696293 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:49.696761 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:49.723121 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:49.731053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:49.732604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:49.735451 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e07ca1e8-9de5-44d5-a86c-9fe70b18c434 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.296352 Apr 01 10:04:49.736834 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 44/100] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:49 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:04:49.993933 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:50.002001 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7ba627a7-1426-4a27-bf0a-744e1e052c1a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.329408 Apr 01 10:04:50.003690 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 57/101] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:49 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:04:50.253179 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:50.253792 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:50.259887 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:50.260333 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:50.261095 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:50.261521 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:50.400274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:50.409516 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-39bbaaa9-5f33-4e85-8f44-a76fe10e02ed tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.160033 Apr 01 10:04:50.419042 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 45/102] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:50 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:50.753653 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:50.754258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:50.760526 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:50.760973 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:50.761736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:50.762168 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:50.905403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:50.913168 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:50.914639 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:50.915759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0a61cc20-badf-439b-95ef-4ba19f132673 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.166623 Apr 01 10:04:50.916320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 58/103] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:50 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:04:51.018595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:51.019242 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:51.026857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:51.027313 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:51.028084 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:51.028579 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:51.173914 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:51.181249 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4b70a1ee-dfe1-446f-8f3c-14e10c3f4252 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.166519 Apr 01 10:04:51.181821 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 46/104] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:51 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:51.431451 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:51.432462 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:51.443061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:51.443799 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:51.445044 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:51.445749 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:51.581582 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:51.589775 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c9f37df0-84ca-4455-bf3f-3c7cb8751c28 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.164964 Apr 01 10:04:51.590353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 59/105] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:51 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:51.612704 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-218a1a8a-ecdc-44dd-9b46-e24cdc784abe req-d1860db8-156a-44ef-9c29-1840057e48a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fecc8e1-f340-4be9-8243-7369fcf1dbca", "name": "network-vif-plugged", "status": "completed", "tag": "e35a73e3-6163-462e-9549-4a90aec2d584"}, {"server_uuid": "acf7fba9-5b94-4c19-8f65-5a3a831b3458", "name": "network-vif-plugged", "status": "completed", "tag": "7309433f-2298-42e8-bf12-5febdcdd2183"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:04:51.621908 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-218a1a8a-ecdc-44dd-9b46-e24cdc784abe req-d1860db8-156a-44ef-9c29-1840057e48a0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:51.622426 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-218a1a8a-ecdc-44dd-9b46-e24cdc784abe req-d1860db8-156a-44ef-9c29-1840057e48a0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:51.635274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-218a1a8a-ecdc-44dd-9b46-e24cdc784abe req-d1860db8-156a-44ef-9c29-1840057e48a0 service nova] Creating event network-vif-plugged:e35a73e3-6163-462e-9549-4a90aec2d584 for instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca on hv-cinder-maste Apr 01 10:04:51.635782 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-218a1a8a-ecdc-44dd-9b46-e24cdc784abe req-d1860db8-156a-44ef-9c29-1840057e48a0 service nova] Creating event network-vif-plugged:7309433f-2298-42e8-bf12-5febdcdd2183 for instance acf7fba9-5b94-4c19-8f65-5a3a831b3458 on hv-cinder-maste Apr 01 10:04:51.642281 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-218a1a8a-ecdc-44dd-9b46-e24cdc784abe req-d1860db8-156a-44ef-9c29-1840057e48a0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033314 Apr 01 10:04:51.642916 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 47/106] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:04:51 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:04:51.933485 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:51.934084 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:51.940614 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:51.941054 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:51.941805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:51.942444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:52.081879 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:52.089956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:52.091508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:52.092612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b5e39009-ba7c-438f-a73e-9b905267fb78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.163242 Apr 01 10:04:52.093185 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 60/107] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:51 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:52.198696 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:52.199420 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:52.206188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:52.206633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:52.207414 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:52.207841 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:52.356142 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:52.363824 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-670eb749-6ca2-473f-90b7-204dcac53a4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.169803 Apr 01 10:04:52.364690 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 48/108] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:52 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:52.607149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:52.607755 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:52.614212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:52.614689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:52.615581 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:52.615899 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:52.756616 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:52.764195 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-87dcf376-a5ad-4557-9bba-8cd0b97bee7b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.160988 Apr 01 10:04:52.764959 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 61/109] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:52 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:53.110740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:53.111384 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:53.117547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:53.118033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:53.118794 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:53.119312 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:53.259870 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:53.271724 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:53.274457 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:53.276190 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-dd3a9358-c574-4f3e-a6aa-81e52d6f4eb7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.169109 Apr 01 10:04:53.277004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 49/110] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:53 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:53.385174 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:53.386115 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:53.393810 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:53.394260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:53.395069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:53.395497 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:53.530952 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:53.538494 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4417d48d-ac5b-4f3d-860a-208082cf5539 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.160070 Apr 01 10:04:53.539088 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 62/111] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:53 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:53.783793 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:53.784639 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:53.795641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:53.796397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:53.797670 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:53.798347 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:53.940509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:53.951860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e5250386-1cda-4e01-8c67-838cd2ab3048 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.173817 Apr 01 10:04:53.952641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 50/112] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:53 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:54.295434 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:54.296031 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:54.302277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:54.302753 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:54.303510 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:54.303939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:54.447051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:54.454869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:54.456337 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:54.457452 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-bc5f2f0c-3985-41f2-ba61-a0115bfc9d8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.166084 Apr 01 10:04:54.458015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 63/113] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:54 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:54.556071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:54.556674 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:54.564032 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:54.564486 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:54.565264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:54.565696 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:54.715854 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:54.724869 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a50dd19f-f183-40fe-bee0-931f9b0d3c59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.172727 Apr 01 10:04:54.725533 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 51/114] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:54 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:54.969380 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:54.970080 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:54.976798 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:54.977213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:54.977981 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:54.978402 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:55.119726 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:55.127264 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-05476eb4-46f1-4f6a-98d4-072bfb43bde2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.162099 Apr 01 10:04:55.127903 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 64/115] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:54 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:55.476038 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:55.476644 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:55.483105 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:55.483554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:55.484321 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:55.484758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:55.623669 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:55.636984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:55.639235 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:55.640368 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-17d96644-2441-4ac8-aa3f-37e3431d9e82 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.168269 Apr 01 10:04:55.640915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 52/116] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:55 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:55.741336 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:55.741953 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:55.748432 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:55.748827 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:55.749592 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:55.750022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:55.887670 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:55.896087 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e6665b25-aa3e-4d81-bd58-d031e15b41bd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.158576 Apr 01 10:04:55.896665 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 65/117] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:55 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:56.144532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:56.145173 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:56.151959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:56.152406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:56.153169 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:56.153606 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:56.470897 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:56.476169 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ca09a326-0d39-43f8-8aff-c4222f3b548f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.335475 Apr 01 10:04:56.476753 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 53/118] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:56 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:56.663407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:56.664436 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:56.673101 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:56.673457 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:56.674208 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:56.674630 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:56.818883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:56.826906 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:56.828413 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:56.829525 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-717b2fb3-eb6d-480c-8393-6ec7c74ccf44 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.172749 Apr 01 10:04:56.830909 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 66/119] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:56 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:04:56.913666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:56.914239 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:56.921533 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:56.922067 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:56.922925 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:56.923416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:57.063214 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:57.070898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9eecc271-6fd6-4ede-ab05-eb0ace1be9ee tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.160948 Apr 01 10:04:57.071468 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 54/120] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:56 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:57.493779 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:57.494113 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:57.500618 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:57.501072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:57.501856 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:57.502269 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:57.638586 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:57.650268 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-693010b4-615b-4171-a7f2-3e2ec8865ed1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.160445 Apr 01 10:04:57.651258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 67/121] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:57 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:57.847492 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:57.848107 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:57.854530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:57.855009 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:57.855770 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:57.856168 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:57.995915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:58.005785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:58.007409 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:58.008491 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-efa4fe9f-a61c-49eb-a254-93c5353147f0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.165038 Apr 01 10:04:58.009068 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 55/122] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:57 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:04:58.088826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:58.089438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:58.096302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:58.096890 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:58.097541 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:58.097999 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:58.241589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:58.249604 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-16309cbe-8bdc-4a46-93cd-29d1bcd2b513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.164745 Apr 01 10:04:58.250173 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 68/123] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:58 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:58.668719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:58.669332 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:58.676397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:58.676858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:58.677639 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:58.678165 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:58.822800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:58.831005 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c2858919-e543-4c49-b519-3aa9532a2b29 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.166420 Apr 01 10:04:58.831592 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 56/124] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:58 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:59.028088 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:59.028596 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:59.035342 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:59.035791 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:59.036705 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:59.037137 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:59.177248 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:59.185963 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:59.187562 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:59.188724 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-df105b64-27da-4795-89af-bfa2e5e53412 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.164747 Apr 01 10:04:59.189360 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 69/125] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:04:59 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:04:59.271483 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:59.272499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:59.283165 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:59.283546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:59.284702 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:59.285141 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:59.425284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:04:59.436095 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6ebc519d-43f0-481d-bd00-3f972b754ef4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.170877 Apr 01 10:04:59.436874 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 57/126] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:59 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:04:59.848202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:04:59.848738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:04:59.858701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:59.858701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:04:59.858701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:04:59.858701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:00.000464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:00.007876 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2e9d77cd-08af-461f-bd25-972f4f83e283 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.163656 Apr 01 10:05:00.008453 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 70/127] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:04:59 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:00.209320 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:00.210317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:00.220677 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:00.221379 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:00.222641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:00.223371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:00.359282 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:00.367218 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:00.368618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:00.369722 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f7f22367-d137-4e8c-bf65-5e8dd6ab7d24 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.166717 Apr 01 10:05:00.370301 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 58/128] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:00 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:00.461228 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:00.461939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:00.468782 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:00.469262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:00.470046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:00.470470 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:00.611963 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:00.620005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ed4ec517-cefa-45fc-bf7d-e2a32382e974 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.164472 Apr 01 10:05:00.620513 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 71/129] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:00 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:01.029134 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:01.029780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:01.036038 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:01.036474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:01.037254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:01.037689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:01.172372 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:01.180627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8af83bf5-1c79-4a4d-92b4-2481770d9b39 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1363 microversion: 2.1 time: 0.155220 Apr 01 10:05:01.181392 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 59/130] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:01 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:01.388533 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:01.389152 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:01.395654 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:01.396102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:01.396859 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:01.397288 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:01.539362 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:01.548304 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:01.549909 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:01.551083 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-858c9974-d35b-4d8c-9490-a00443672858 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.166549 Apr 01 10:05:01.551709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 72/131] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:01 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:01.640210 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:01.640937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:01.648044 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:01.648754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:01.649543 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:01.649979 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:01.790230 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:01.798344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-035e5ac6-fd67-4b2c-bb02-ff68fd2b8db6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.161967 Apr 01 10:05:01.798982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 60/132] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:01 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:02.129229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:02.129717 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:02.136004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.136456 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.137256 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.137686 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.162035 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:05:02.197784 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:02.198484 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:02.204834 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.205374 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.206240 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.206791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.312102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-be3ba80e-1724-4e2a-8220-9bd919560f8e tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 204 len: 0 microversion: 2.1 time: 0.186739 Apr 01 10:05:02.312884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 73/133] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:05:02 2022] DELETE /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:05:02.320767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:02.321458 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:02.327482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.327936 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.328711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.329145 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.351819 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:02.359686 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4b2cde19-0e45-4a99-92c2-5c331b8faa35 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1550 microversion: 2.1 time: 0.166167 Apr 01 10:05:02.360283 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 61/134] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:02 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1550 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:02.376453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f5d1ae49-2661-4ceb-b914-823d6e8161a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:02.376954 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f5d1ae49-2661-4ceb-b914-823d6e8161a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:02.382889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5d1ae49-2661-4ceb-b914-823d6e8161a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.383346 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5d1ae49-2661-4ceb-b914-823d6e8161a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.384119 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5d1ae49-2661-4ceb-b914-823d6e8161a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.384552 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5d1ae49-2661-4ceb-b914-823d6e8161a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.468944 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:02.472917 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f5d1ae49-2661-4ceb-b914-823d6e8161a4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100164 Apr 01 10:05:02.473603 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 62/135] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:05:02 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:05:02.477180 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6bc65631-48ba-4fa7-a572-081ac46d6bad tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.160317 Apr 01 10:05:02.477766 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 74/136] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:02 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:02.571338 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:02.571953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:02.578172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.578614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.579403 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.579826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.815883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:02.816564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:02.823146 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.823665 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.824523 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:02.825024 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:02.860099 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:02.868726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:02.870386 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:02.871712 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-630888e9-3326-482f-a34a-5b4edcd096d6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.304358 Apr 01 10:05:02.872423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 63/137] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:02 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:02.957392 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:02.965009 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-31377f36-e579-41dd-ad3b-4287f9a6926e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.153278 Apr 01 10:05:02.965586 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 75/138] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:02 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:03.497251 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:03.497963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:03.505160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:03.505702 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:03.506574 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:03.507089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:03.760548 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:03.768697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c7197c26-699e-4d7a-8f4f-d3cd353353d1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.275912 Apr 01 10:05:03.769275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 64/139] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:03 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:03.890685 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:03.891493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:03.898221 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:03.898771 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:03.899611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:03.900117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:03.953608 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-d69eeef8-af90-470d-b48c-059e33e357a2 req-e05397dd-aebe-4e0a-a656-34e2df32e6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7fecc8e1-f340-4be9-8243-7369fcf1dbca", "tag": "e35a73e3-6163-462e-9549-4a90aec2d584"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:05:03.961807 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-d69eeef8-af90-470d-b48c-059e33e357a2 req-e05397dd-aebe-4e0a-a656-34e2df32e6b4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:03.962299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-d69eeef8-af90-470d-b48c-059e33e357a2 req-e05397dd-aebe-4e0a-a656-34e2df32e6b4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:03.974591 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-d69eeef8-af90-470d-b48c-059e33e357a2 req-e05397dd-aebe-4e0a-a656-34e2df32e6b4 service nova] Creating event network-changed:e35a73e3-6163-462e-9549-4a90aec2d584 for instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca on hv-cinder-maste Apr 01 10:05:03.980416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-d69eeef8-af90-470d-b48c-059e33e357a2 req-e05397dd-aebe-4e0a-a656-34e2df32e6b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030577 Apr 01 10:05:03.981292 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 65/140] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:03.986839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:03.987668 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:03.994045 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:03.994681 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:03.995553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:03.996047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:04.039872 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:04.047873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:04.049576 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:04.050711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3c030e48-cd58-42c1-95a4-92e67a2e9f3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.164763 Apr 01 10:05:04.051283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 76/141] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:03 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:04.131983 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:04.139885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8d5b68bc-de9e-47e0-965a-ef9dde0bb037 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.157254 Apr 01 10:05:04.140547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 66/142] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:03 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:04.785961 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:04.786900 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:04.792844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:04.793281 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:04.794037 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:04.794460 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:04.929772 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:04.937694 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d6348ebf-aab6-4782-96a8-9babe114c25a tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.155972 Apr 01 10:05:04.938617 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 77/143] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:04 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:05.069298 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:05.069888 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:05.077026 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:05.077475 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:05.078546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:05.079015 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:05.156619 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:05.157243 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:05.163744 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:05.164198 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:05.165006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:05.165439 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:05.220223 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:05.229245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:05.230813 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:05.231965 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-133e97fa-f59c-4b22-9e29-5c84be7a1b57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.166802 Apr 01 10:05:05.242611 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 67/144] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:05 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:05.309259 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:05.316822 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ff0b5a26-45ca-4f04-9f4d-ddf5bd858f8d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.164232 Apr 01 10:05:05.317411 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 78/145] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:05 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:05.955351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:05.955948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:05.962525 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:05.963095 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:05.963872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:05.964302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:06.103145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:06.112162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7b2621ac-4e6a-45b6-9f9d-df1ed96c6132 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.160633 Apr 01 10:05:06.112746 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 68/146] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:05 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:06.254716 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:06.255670 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:06.265568 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:06.266006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:06.266814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:06.267243 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:06.334386 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:06.334921 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:06.341278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:06.341909 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:06.342689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:06.343138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:06.409704 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:06.418987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:06.420566 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:06.421734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f502bd1c-f34f-45ae-8045-65bdc872311c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.173824 Apr 01 10:05:06.422467 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 79/147] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:06 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:06.484206 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:06.492173 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-687a72ed-d9aa-4fc8-8be7-9710139f8b16 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.161824 Apr 01 10:05:06.492747 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 69/148] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:06 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:07.133672 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:07.134711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:07.143164 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:07.143614 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:07.144414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:07.144849 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:07.281960 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:07.290135 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-56a2bd8e-1d90-4740-b407-cfbcba940ed8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.163119 Apr 01 10:05:07.290747 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 80/149] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:07 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:07.440968 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:07.442209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:07.456138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:07.456586 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:07.457773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:07.458201 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:07.509169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:07.509786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:07.520959 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:07.525812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:07.526788 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:07.527318 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:07.642609 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:07.651008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:07.652538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:07.653659 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b45f39aa-b0a3-47cf-9b1f-dcd708e823fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1407 microversion: 2.20 time: 0.217108 Apr 01 10:05:07.654227 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 70/150] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:07 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1407 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:07.753896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:07.761624 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ddfd74eb-9250-4fc3-9a41-c7d2fdf2fc85 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.256529 Apr 01 10:05:07.762211 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 81/151] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:07 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:08.308266 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:08.308975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:08.315253 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:08.315705 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:08.316465 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:08.316888 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:08.456959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:08.468206 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-319b1269-1aa9-4bea-a690-edc767ee171f tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.164226 Apr 01 10:05:08.468800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 71/152] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:08 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:08.673939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:08.674887 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:08.681344 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:08.681795 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:08.682709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:08.683090 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:08.779437 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:08.780342 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:08.787355 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:08.787819 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:08.788610 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:08.789045 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:08.949241 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:08.960417 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ec613931-0694-49eb-b403-639e0c681416 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.185563 Apr 01 10:05:08.970940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 72/153] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:08 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:09.100201 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:09.109679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:09.111728 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:09.113141 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-276be8f8-e10c-4b63-b5f2-be971669228b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1600 microversion: 2.20 time: 0.443261 Apr 01 10:05:09.126928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 82/154] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:05:08 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1600 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:05:09.134274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f5a93fd5-267a-4eb5-a50f-f10be57919f6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:09.134791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f5a93fd5-267a-4eb5-a50f-f10be57919f6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:09.141835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a93fd5-267a-4eb5-a50f-f10be57919f6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:09.142839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a93fd5-267a-4eb5-a50f-f10be57919f6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:09.144205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a93fd5-267a-4eb5-a50f-f10be57919f6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:09.144827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a93fd5-267a-4eb5-a50f-f10be57919f6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:09.245353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f5a93fd5-267a-4eb5-a50f-f10be57919f6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.115393 Apr 01 10:05:09.246319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 73/155] 10.222.0.46 () {60 vars in 1315 bytes} [Fri Apr 1 10:05:09 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:05:09.485887 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:09.487141 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:09.510011 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:09.510463 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:09.511279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:09.514426 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:09.895497 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:09.903863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3397ad55-a1a6-4853-bb0a-db8803d02346 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.422078 Apr 01 10:05:09.904433 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 83/156] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:09 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:09.978553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:09.979865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:09.987249 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:09.987696 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:09.988593 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:09.989105 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:10.157753 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:10.165934 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-215ed0f5-d796-480c-838e-7700802fdced tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.192160 Apr 01 10:05:10.166529 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 74/157] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:09 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:10.922099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:10.922881 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:10.935284 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:10.938409 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:10.944567 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:10.945601 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:11.056984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-5ae8e4bd-2d9c-4d9b-87e8-c5f6e6290fbd req-1ac057f9-b46b-4ea9-b86b-c2647c21858c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0c911a2-ef42-4d2a-bea9-a6c56575559f", "tag": "b8c404b8-1348-40f2-87ab-56e8fc6c155a"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:05:11.066071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-5ae8e4bd-2d9c-4d9b-87e8-c5f6e6290fbd req-1ac057f9-b46b-4ea9-b86b-c2647c21858c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:11.066557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-5ae8e4bd-2d9c-4d9b-87e8-c5f6e6290fbd req-1ac057f9-b46b-4ea9-b86b-c2647c21858c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:11.080669 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-5ae8e4bd-2d9c-4d9b-87e8-c5f6e6290fbd req-1ac057f9-b46b-4ea9-b86b-c2647c21858c service nova] Creating event network-changed:b8c404b8-1348-40f2-87ab-56e8fc6c155a for instance f0c911a2-ef42-4d2a-bea9-a6c56575559f on hv-cinder-maste Apr 01 10:05:11.086114 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-5ae8e4bd-2d9c-4d9b-87e8-c5f6e6290fbd req-1ac057f9-b46b-4ea9-b86b-c2647c21858c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036247 Apr 01 10:05:11.087145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 75/158] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:05:11.176315 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:11.185802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d756603c-d265-414c-9af1-15df2d0508a2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.267572 Apr 01 10:05:11.186308 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:11.187063 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:11.197162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:11.197162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:11.197162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:11.197162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:11.198225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 84/159] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:10 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:11.339145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:11.349766 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3a5ab3b1-d328-4175-bfd7-d4eed36d4a45 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.168631 Apr 01 10:05:11.357720 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 76/160] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:11 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:12.204917 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:12.205543 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:12.212092 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:12.212545 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:12.213672 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:12.213805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:12.353450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:12.361865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-886bde9d-5a90-49d9-a2a3-88d1ad5951e1 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.160928 Apr 01 10:05:12.362438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 85/161] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:12 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:12.366778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:12.367363 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:12.373882 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:12.374329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:12.375114 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:12.375588 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:12.511641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:12.519394 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b7d80efb-77a5-4f55-9fff-3083a8a93cdd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.156670 Apr 01 10:05:12.519970 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 77/162] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:12 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:13.379889 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:13.380484 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:13.386928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:13.387372 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:13.388128 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:13.388548 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:13.533870 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:13.537423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:13.538038 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:13.541941 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ff927265-b77a-4010-87eb-955a88f4c97c tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.166009 Apr 01 10:05:13.542511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 86/163] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:13 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:13.544766 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:13.545207 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:13.546048 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:13.546473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:13.697203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:13.704817 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d3a9dade-ac45-4fd9-8be4-3b3ac6bb14a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.171955 Apr 01 10:05:13.705395 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 78/164] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:13 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:14.568784 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:14.569792 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:14.579564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:14.580037 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:14.580807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:14.581239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:14.721693 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:14.722243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:14.728648 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:14.729093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:14.730045 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:14.730669 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:14.835950 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:14.845635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-dda2973d-054c-44fc-90ea-95a7f06af825 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.282781 Apr 01 10:05:14.846366 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 87/165] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:14 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:14.872206 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:14.879623 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-94a71aa4-d0da-4118-a04c-7565928a7cec tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.162051 Apr 01 10:05:14.880191 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 79/166] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:14 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:15.865332 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:15.866073 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:15.875173 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:15.875807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:15.876912 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:15.877522 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:15.900111 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:15.901317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:15.908347 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:15.908774 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:15.909563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:15.909989 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:16.023900 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:16.034225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-dd65e9c3-bf4f-41a6-a845-5d75b037a438 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1551 microversion: 2.1 time: 0.174253 Apr 01 10:05:16.034939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 88/167] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:15 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1551 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:16.058819 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:16.068296 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bf88439a-24b8-4ca7-bdb9-1f5c6698d2a5 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.174803 Apr 01 10:05:16.068881 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 80/168] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:15 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:17.009299 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-e967c3c3-caec-454a-a8aa-444cafa3149d req-c7539071-df0d-47c1-b7dd-1b7b393fb0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce347c63-a71c-42d4-9c03-03c4d28f515b", "name": "network-vif-deleted", "tag": "f3e53471-0d0b-47a5-8d97-64f53ef18e1e"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:05:17.022791 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-e967c3c3-caec-454a-a8aa-444cafa3149d req-c7539071-df0d-47c1-b7dd-1b7b393fb0d4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:17.023495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-e967c3c3-caec-454a-a8aa-444cafa3149d req-c7539071-df0d-47c1-b7dd-1b7b393fb0d4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:17.035729 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-e967c3c3-caec-454a-a8aa-444cafa3149d req-c7539071-df0d-47c1-b7dd-1b7b393fb0d4 service nova] Creating event network-vif-deleted:f3e53471-0d0b-47a5-8d97-64f53ef18e1e for instance ce347c63-a71c-42d4-9c03-03c4d28f515b on hv-cinder-maste Apr 01 10:05:17.041466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-e967c3c3-caec-454a-a8aa-444cafa3149d req-c7539071-df0d-47c1-b7dd-1b7b393fb0d4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035840 Apr 01 10:05:17.042396 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 89/169] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:05:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:17.052004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:17.052654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:17.059899 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:17.060337 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:17.061312 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:17.061741 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:17.086005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:17.087215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:17.093731 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:17.094254 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:17.095238 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:17.095741 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:17.126149 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:17.136885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ae47361f-2292-4d22-97a4-84b59ab54bc2 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1345 microversion: 2.1 time: 0.088894 Apr 01 10:05:17.137630 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 81/170] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:17 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1345 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:17.230716 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:17.240361 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-60641db0-e290-4fd8-89c0-0eb4e06998b9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.158581 Apr 01 10:05:17.240878 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 90/171] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:17 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:18.153889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:18.155292 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:18.162146 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:18.162586 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:18.163652 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:18.164079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:18.197469 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:18.197987 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:18.198561 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lazy-loading 'fault' on Instance uuid ce347c63-a71c-42d4-9c03-03c4d28f515b {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:05:18.244799 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd3b377ae39b4f2387db5fb30716aff3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3b3649989d44826a64e8a7ee24dbf90', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:18.252151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0e4fff9a-fbc0-4460-83e7-41e925fb6bf3 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 200 len: 1304 microversion: 2.1 time: 0.102133 Apr 01 10:05:18.252669 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 82/172] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:18 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:18.257451 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:18.258182 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:18.264111 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:18.264556 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:18.265314 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:18.265744 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:18.402673 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:18.410730 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c2e37a08-35bd-4219-bed8-d4369b03a898 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.157090 Apr 01 10:05:18.411414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 91/173] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:18 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:19.273996 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:19.275029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:19.284440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:19.284880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:19.285635 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:19.286062 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:19.301690 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] HTTP exception thrown: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. Apr 01 10:05:19.302491 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Returning 404 to user: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:05:19.303380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3260015d-c7e0-44f0-a21a-1b52c2d5d2d9 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 404 len: 111 microversion: 2.1 time: 0.036412 Apr 01 10:05:19.303942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 83/174] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:19 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:05:19.409254 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:19.410283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:19.416573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:19.417061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:19.417829 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:19.418258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:19.426970 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:19.427749 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:19.431621 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] HTTP exception thrown: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. Apr 01 10:05:19.432219 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Returning 404 to user: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:05:19.433102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-48cbeb7a-0714-447d-afe6-1f28e18d52df tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.028173 Apr 01 10:05:19.433684 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 92/175] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:05:19 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b/os-volume_attachments => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:05:19.434204 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:19.434766 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:19.435533 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:19.435963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:19.587789 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:19.596726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d642c340-5fed-4f2c-8fa1-8bb07baa13c1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.173701 Apr 01 10:05:19.597359 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 84/176] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:19 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:20.613735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:20.614338 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:20.620378 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:20.620825 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:20.621763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:20.622191 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:20.761775 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:20.770184 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-294549ba-98b0-4760-a491-49046ee2a52d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.160347 Apr 01 10:05:20.770880 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 93/177] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:20 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:21.788199 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:21.788881 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:21.795829 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:21.796277 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:21.797050 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:21.797485 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:21.936740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:21.947728 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2268e2ce-37b0-4cd2-b7b5-96fc2ab2d8e1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.163429 Apr 01 10:05:21.948501 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 85/178] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:21 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:22.968547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:22.969493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:22.978239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:22.978683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:22.979472 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:22.979966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:23.120131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:23.128169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c3ec2d11-638d-4e7c-ba75-1b34d0b03278 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.166123 Apr 01 10:05:23.128733 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 94/179] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:22 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:24.151753 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:24.152392 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:24.159423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:24.159886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:24.160674 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:24.161120 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:24.300544 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:24.311345 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bb97b2b1-bfb1-419f-bca7-4e493d0aac44 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.164491 Apr 01 10:05:24.312174 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 86/180] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:24 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:25.332854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:25.333908 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:25.344310 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:25.345049 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:25.346312 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:25.347069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:25.488561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:25.496726 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-baef5daa-2f8a-4925-a446-3cd80924a6a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.170168 Apr 01 10:05:25.497294 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 95/181] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:25 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:26.513501 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:26.514132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:26.520859 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:26.521311 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:26.522380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:26.522899 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:26.674205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:26.682316 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bb632bb0-f07c-4d25-b50f-bda3400defe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.172647 Apr 01 10:05:26.682920 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 87/182] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:26 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:27.700423 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:27.701085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:27.707116 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:27.707611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:27.708369 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:27.708784 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:27.847547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:27.855044 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f7f6b03c-a3d8-43c3-b45d-34575f2dc6e8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.158517 Apr 01 10:05:27.855627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 96/183] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:27 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:28.876010 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:28.876992 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:28.887555 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:28.888291 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:28.889634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:28.890242 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:29.021147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:29.021645 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:29.027517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:29.027999 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:29.028796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:29.029229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:29.032250 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:29.039438 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-267d02f7-e8af-47e0-b879-c9c51927dc56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.170084 Apr 01 10:05:29.040005 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 88/184] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:28 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:29.042564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] HTTP exception thrown: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. Apr 01 10:05:29.043183 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Returning 404 to user: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:05:29.044009 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d8f298ce-e5c8-48fb-b6a9-62036c92a9b0 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "DELETE /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 404 len: 111 microversion: 2.1 time: 0.027219 Apr 01 10:05:29.044538 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 97/185] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:05:29 2022] DELETE /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:05:29.052082 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:29.052709 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] [instance: ce347c63-a71c-42d4-9c03-03c4d28f515b] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:29.058494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:29.058968 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:29.059719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:29.060138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:29.072726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] HTTP exception thrown: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. Apr 01 10:05:29.073354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] Returning 404 to user: Instance ce347c63-a71c-42d4-9c03-03c4d28f515b could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:05:29.074148 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-dc271831-5ea5-4d2e-b35d-51c1c8ac25f8 tempest-DeleteServersTestJSON-1500504516 tempest-DeleteServersTestJSON-1500504516-project] 10.222.0.46 "GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b" status: 404 len: 111 microversion: 2.1 time: 0.025682 Apr 01 10:05:29.074679 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 89/186] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:29 2022] GET /compute/v2.1/servers/ce347c63-a71c-42d4-9c03-03c4d28f515b => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 01 10:05:30.056405 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:30.057014 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:30.063053 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:30.063344 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:30.073580 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:30.073580 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:30.204353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:30.211951 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ea60d376-c393-429c-a22e-0bfc87283f8e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.159510 Apr 01 10:05:30.212521 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 98/187] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:30 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:31.229202 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:31.229769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:31.236454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:31.236900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:31.237666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:31.238090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:31.382074 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:31.389442 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e23f8466-2b59-48f2-ae39-dbed49e48222 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.164249 Apr 01 10:05:31.390236 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 90/188] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:31 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:32.410440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:32.411484 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:32.421624 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:32.422370 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:32.423718 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:32.424470 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:32.556844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:32.564948 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d3c9db32-1284-4d51-9daf-9240f9b1dfa0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.160919 Apr 01 10:05:32.565493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 99/189] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:32 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:33.585773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:33.586816 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:33.597328 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:33.598086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:33.599467 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:33.600188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:33.744940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:33.756993 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-27a4d888-30ff-4388-86cc-f5071d83f47f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.177217 Apr 01 10:05:33.757888 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 91/190] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:33 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:34.776094 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:34.776628 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:34.783214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:34.783678 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:34.784565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:34.785051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:34.925548 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:34.933676 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-562c6053-ddfe-4cb2-9de5-32a81a8e392d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.161984 Apr 01 10:05:34.934413 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 100/191] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:34 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:35.951066 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:35.951685 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:35.958151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:35.958606 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:35.959383 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:35.959819 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:36.111328 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:36.119043 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f4c069e1-0281-471a-93d5-34c7cffd46ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.171978 Apr 01 10:05:36.119646 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 92/192] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:35 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:37.135367 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:37.135963 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:37.144818 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:37.144818 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:37.144818 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:37.144818 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:37.289011 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:37.300468 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0959052c-7259-46aa-b18e-851c9ca39830 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.168820 Apr 01 10:05:37.301085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 101/193] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:37 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:37.735793 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-21ef61f4-93c2-4156-8fa8-419174ddc920 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edb3fe50>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:37.789752 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-21ef61f4-93c2-4156-8fa8-419174ddc920 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d22e16f6-1e2c-4501-acd8-2ea523874061" status: 200 len: 351 microversion: 2.1 time: 0.057992 Apr 01 10:05:37.790325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 93/194] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:05:37 2022] GET /compute/v2.1/os-volumes/d22e16f6-1e2c-4501-acd8-2ea523874061 => generated 351 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:38.321196 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:38.321761 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:38.328585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:38.329024 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:38.329784 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:38.330207 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:38.463985 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:38.474553 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-45edd94c-3dfd-4579-87bb-2fccfe74eff8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.157025 Apr 01 10:05:38.475222 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 102/195] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:38 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:39.114400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4a28545a-4cfe-4fd7-b4ec-b8a2198d6f02 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edc4e160>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:39.167927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4a28545a-4cfe-4fd7-b4ec-b8a2198d6f02 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/b9e0b5be-a5f7-466e-8646-a38134da557b" status: 200 len: 350 microversion: 2.1 time: 0.057460 Apr 01 10:05:39.168743 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 94/196] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:05:39 2022] GET /compute/v2.1/os-volumes/b9e0b5be-a5f7-466e-8646-a38134da557b => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:39.497197 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:39.498087 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:39.505823 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:39.506390 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:39.507537 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:39.508290 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:39.683668 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:39.692419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4464fd68-58c3-4724-b281-05ecb31c996e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1520 microversion: 2.1 time: 0.199707 Apr 01 10:05:39.693091 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 103/197] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:39 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:40.496978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-85b57f3f-ffed-44bb-a160-1ab8f5551c5f tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edb50a60>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:40.554064 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-85b57f3f-ffed-44bb-a160-1ab8f5551c5f tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/df5ee311-96bd-48a6-83ce-03328e553b4e" status: 200 len: 350 microversion: 2.1 time: 0.061986 Apr 01 10:05:40.565064 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 95/198] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:05:40 2022] GET /compute/v2.1/os-volumes/df5ee311-96bd-48a6-83ce-03328e553b4e => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:40.576817 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cc254391-2d6e-4846-8d4e-199b65219aa5 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64ee4765e0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:40.663569 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cc254391-2d6e-4846-8d4e-199b65219aa5 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097197 Apr 01 10:05:40.671150 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 104/199] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Apr 1 10:05:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:40.676826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-41915c33-c75b-4699-b907-1146ad5e712a tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edbf1a60>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:40.711022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:40.711857 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:40.718878 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:40.719666 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:40.720696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:40.721366 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:40.768972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-41915c33-c75b-4699-b907-1146ad5e712a tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.095224 Apr 01 10:05:40.770156 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 96/200] 10.222.0.46 () {58 vars in 1148 bytes} [Fri Apr 1 10:05:40 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:40.782583 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ca4965ad-dfe5-44ce-9821-5119d82758c5 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edb3f1f0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:40.891810 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ca4965ad-dfe5-44ce-9821-5119d82758c5 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.112916 Apr 01 10:05:40.892330 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 97/201] 10.222.0.46 () {58 vars in 1133 bytes} [Fri Apr 1 10:05:40 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:05:40.906454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-824118ad-af31-4f05-ac5f-414ccf0c9e40 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edb3f280>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:40.915924 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:40.931228 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b7f3d1ca-3245-4607-9d7f-f422c6c79db0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1500 microversion: 2.1 time: 0.224980 Apr 01 10:05:40.933022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 105/202] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:40 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1500 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:40.952827 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:40.953440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:40.961073 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:40.961917 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:40.963149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:40.965861 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:41.006506 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-824118ad-af31-4f05-ac5f-414ccf0c9e40 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104277 Apr 01 10:05:41.007298 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 98/203] 10.222.0.46 () {58 vars in 1166 bytes} [Fri Apr 1 10:05:40 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:41.019412 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8e745274-f1a0-48d6-8dc3-7c0081b53b26 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edbccdc0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:41.115567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8e745274-f1a0-48d6-8dc3-7c0081b53b26 tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.099873 Apr 01 10:05:41.123470 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 99/204] 10.222.0.46 () {58 vars in 1169 bytes} [Fri Apr 1 10:05:41 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:05:41.128430 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dc43425c-2d7d-4fd1-9e27-eb963c72138a tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edb3f550>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:41.154168 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:41.161496 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-81197ed6-190b-40fb-bf18-88f69ef3f683 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1516 microversion: 2.1 time: 0.217302 Apr 01 10:05:41.162273 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 106/205] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:40 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1516 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:41.239269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-dc43425c-2d7d-4fd1-9e27-eb963c72138a tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.114485 Apr 01 10:05:41.239871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 100/206] 10.222.0.46 () {58 vars in 1154 bytes} [Fri Apr 1 10:05:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:41.257957 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-55b6f366-1431-4b17-9769-c9561b93e19a tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64ee476ca0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:41.352530 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-55b6f366-1431-4b17-9769-c9561b93e19a tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.104009 Apr 01 10:05:41.359821 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 107/207] 10.222.0.46 () {58 vars in 1187 bytes} [Fri Apr 1 10:05:41 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:05:41.364768 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-edb741f2-1714-422f-bcaf-c87fdd0fe27e tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] Calling method '.version_select at 0x7f64edbf1040>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:41.461793 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-edb741f2-1714-422f-bcaf-c87fdd0fe27e tempest-VolumesTestJSON-1814834983 tempest-VolumesTestJSON-1814834983-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.100740 Apr 01 10:05:41.462397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 101/208] 10.222.0.46 () {58 vars in 1154 bytes} [Fri Apr 1 10:05:41 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:42.596728 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:05:42.598245 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:42.604310 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:42.604778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:42.605558 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:42.605982 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:42.631743 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.objects.instance [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lazy-loading 'flavor' on Instance uuid acf7fba9-5b94-4c19-8f65-5a3a831b3458 {{(pid=117066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:05:42.821167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-63279601-3444-4d1c-a65d-0c84839a93b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458/action" status: 200 len: 32 microversion: 2.1 time: 0.228478 Apr 01 10:05:42.821271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 108/209] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:05:42 2022] POST /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458/action => generated 32 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 01 10:05:42.844581 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:42.845927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:42.857630 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:42.858440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:42.859292 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:42.859720 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:43.045647 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:43.054203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-66f96c8c-5a48-4f0f-b893-e6c5efd2c2ae tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.225713 Apr 01 10:05:43.054975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 102/210] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:42 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:44.071974 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:44.072777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:44.078932 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:44.079395 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:44.080161 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:44.080706 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:44.230917 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:44.238491 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-12c84b9f-c589-4d88-a467-1467b2dbb4a9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.170666 Apr 01 10:05:44.239176 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 109/211] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:44 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:45.258127 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:45.258947 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:45.265476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:45.266257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:45.267062 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:45.267499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:45.417403 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:45.426039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0f347881-307e-4bef-92e0-9d2b92cb1adc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.174254 Apr 01 10:05:45.426779 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 103/212] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:45 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:46.447036 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:46.448051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:46.455058 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:46.455631 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:46.456580 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:46.457154 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:46.621695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:46.629733 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1e4997a9-dabd-4d2b-9555-a6792f9f2c9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.189283 Apr 01 10:05:46.630400 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 110/213] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:46 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:47.648263 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:47.648826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:47.655976 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:47.656444 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:47.657221 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:47.657648 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:47.849278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:47.858279 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c32ecaed-996c-4e3b-b29b-3cad5f9b8410 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.214714 Apr 01 10:05:47.859327 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 104/214] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:47 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:48.875867 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:48.876453 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:48.882703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:48.883162 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:48.883938 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:48.885025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:49.120253 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:49.128623 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cd5859b1-641a-47b8-96f8-387b3d74c9e9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.256646 Apr 01 10:05:49.129376 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 111/215] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:48 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:50.146241 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:50.148210 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:50.154818 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:50.155564 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:50.156413 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:50.156875 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:50.292710 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:50.300481 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-69c184b4-ce7f-4045-8526-294c9faffed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.159096 Apr 01 10:05:50.301051 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 105/216] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:50 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:51.318606 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:51.319439 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:51.325539 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:51.325958 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:51.326931 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:51.327509 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:51.473087 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:51.480509 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2e467bbf-50f3-4bcb-8bcb-c1ace7ea508a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.166979 Apr 01 10:05:51.481107 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 112/217] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:51 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:52.497366 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:52.498071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:52.504700 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:52.505160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:52.505936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:52.506369 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:52.657694 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:52.665959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3f4cdaac-7ae4-4615-bb86-e076bec3e919 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.172472 Apr 01 10:05:52.675212 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 106/218] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:52 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:53.684960 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:53.686316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:53.693326 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:53.693812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:53.694633 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:53.695249 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:53.848029 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:53.857196 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a8905d4c-dd46-4392-88db-f05fdeeb0352 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.177831 Apr 01 10:05:53.857499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 113/219] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:53 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:54.874304 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:54.875686 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:54.884916 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:54.885756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:54.888253 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:54.888948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:55.033867 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:55.042003 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-61c8cfb6-fb2d-4139-bd39-4415184eda57 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.171756 Apr 01 10:05:55.042407 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 107/220] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:54 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:56.060202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:56.060860 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:56.068173 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:56.068856 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:56.069771 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:56.070805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:56.245731 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:56.253989 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-97e2a9ec-1366-410c-9497-c05e1eb7dbaa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.198551 Apr 01 10:05:56.255057 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 114/221] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:56 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:57.272048 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:57.272663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:57.280381 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:57.281076 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:57.282285 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:57.283021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:57.420787 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:57.428907 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1502971c-beb3-4368-9720-b44fff2eac0c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.161313 Apr 01 10:05:57.429466 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 108/222] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:57 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:58.446609 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:58.447241 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:58.453841 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:58.454815 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:58.455593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:58.456024 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:58.593315 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:58.602905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1d74cdda-4013-4e99-a566-f9c0cf70043e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.160614 Apr 01 10:05:58.603486 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 115/223] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:58 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:05:59.624468 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:05:59.625380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:05:59.636120 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:59.636864 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:59.638122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:05:59.638893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:05:59.781106 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:05:59.792163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c48d9e57-451b-4fdb-8b48-be8b0e8ea761 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.174113 Apr 01 10:05:59.792969 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 109/224] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:05:59 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:00.814022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:00.814919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:00.825157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:00.826108 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:00.827407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:00.828165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:00.971262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:00.979511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-81f73274-e6a4-4a1d-a7df-461383827d52 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.172070 Apr 01 10:06:00.980154 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 116/225] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:00 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:02.003207 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:02.004276 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:02.014092 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:02.014624 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:02.015410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:02.015948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:02.148145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:02.155932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8c909b34-f463-4024-9731-803e3d2cb622 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.159917 Apr 01 10:06:02.156496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 110/226] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:01 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:03.177187 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:03.178213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:03.187738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:03.188180 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:03.188941 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:03.189366 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:03.335792 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:03.343693 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a9bac608-bcd4-412e-933e-5f0cc01b1039 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.172977 Apr 01 10:06:03.344271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 117/227] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:03 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:04.361894 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:04.362629 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:04.369505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:04.370044 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:04.370959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:04.371460 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:04.516532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:04.524674 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2ab29898-8b7f-4b56-87f9-1cabc3a92086 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.166851 Apr 01 10:06:04.525435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 111/228] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:04 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:05.542365 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:05.543679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:05.565088 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:05.565610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:05.566429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:05.566884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:05.739422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:05.747155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-12e25433-444e-4361-a0f8-f4b75d485da0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.209147 Apr 01 10:06:05.747749 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 118/229] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:05 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:06.764185 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:06.764769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:06.771804 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:06.772245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:06.773002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:06.773410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:06.955422 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:06.963108 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-59b9c68d-7c0c-4064-8292-ffd3195393af tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.202809 Apr 01 10:06:06.963793 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 112/230] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:06 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:07.982081 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:07.984425 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:07.994743 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:07.995513 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:07.996590 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:07.997250 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:08.153812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:08.161553 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9c9a2abd-40b8-4345-95da-1b5df7054f7c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1502 microversion: 2.1 time: 0.185369 Apr 01 10:06:08.162097 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 119/231] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:07 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1502 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:08.178455 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65e23d16-9207-47bd-a58f-ec1e03c34a08"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:08.179261 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:08.185657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:08.186102 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:08.186896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:08.187328 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:08.209948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] HTTP exception thrown: Cannot 'attach_volume' instance acf7fba9-5b94-4c19-8f65-5a3a831b3458 while it is in vm_state rescued Apr 01 10:06:08.210538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Returning 409 to user: Cannot 'attach_volume' instance acf7fba9-5b94-4c19-8f65-5a3a831b3458 while it is in vm_state rescued {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:06:08.211393 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-114644b1-a3ae-41e5-90c0-378569d64188 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.037322 Apr 01 10:06:08.211942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 113/232] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:06:08 2022] POST /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458/os-volume_attachments => generated 152 bytes in 38 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 01 10:06:08.220760 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-41134482-1e02-4e81-aee0-78a2182de0cc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:08.221364 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-41134482-1e02-4e81-aee0-78a2182de0cc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:08.227228 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41134482-1e02-4e81-aee0-78a2182de0cc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:08.227733 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41134482-1e02-4e81-aee0-78a2182de0cc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:08.228590 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41134482-1e02-4e81-aee0-78a2182de0cc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:08.229074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41134482-1e02-4e81-aee0-78a2182de0cc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:08.298000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-41134482-1e02-4e81-aee0-78a2182de0cc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458/action" status: 202 len: 0 microversion: 2.1 time: 0.080932 Apr 01 10:06:08.302017 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 120/233] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:06:08 2022] POST /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:06:08.307894 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:08.308500 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:08.315210 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:08.315760 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:08.316660 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:08.317157 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:08.455126 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:08.462839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3bef4b53-3028-4745-bb76-357a1250ca66 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1510 microversion: 2.1 time: 0.159722 Apr 01 10:06:08.463406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 114/234] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:08 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1510 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:09.481351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:09.482017 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:09.488633 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:09.489110 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:09.489874 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:09.490319 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:09.627609 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:09.635375 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1fba513b-7e9f-46d3-a4b4-696bd8758655 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1510 microversion: 2.1 time: 0.158297 Apr 01 10:06:09.636309 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 121/235] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:09 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:10.154905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1105667788", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "networks": [{"uuid": "4b05cb53-9743-4e0b-9b86-b26d0ecaecc9"}]}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:10.206425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] validate_networks() for [('4b05cb53-9743-4e0b-9b86-b26d0ecaecc9', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:06:10.542028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:06:10.542546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:06:10.543099 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:06:10.543593 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:06:10.544067 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:06:10.553390 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:10.553923 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:10.554846 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:10.555348 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:10.572339 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Getting quotas for project 47d184624c1d4bae9384dc4be14343fd. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:06:10.576471 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Getting quotas for user b687f70831024cac87826377235bd5a6 and project 47d184624c1d4bae9384dc4be14343fd. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:06:10.587557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:06:10.589827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:06:10.634193 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1a8b582d-4c58-48ad-ae87-9602db00e782 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.483138 Apr 01 10:06:10.634987 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 115/236] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:06:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:06:10.645478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6f7738ef-61f0-44d5-ad90-4152184c4994 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:10.646086 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6f7738ef-61f0-44d5-ad90-4152184c4994 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:10.659357 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:10.660559 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:10.675597 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:10.677350 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:10.678389 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:10.680761 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:10.699630 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6f7738ef-61f0-44d5-ad90-4152184c4994 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:10.706885 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6f7738ef-61f0-44d5-ad90-4152184c4994 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1214 microversion: 2.1 time: 0.065222 Apr 01 10:06:10.708103 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 122/237] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:10 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:10.839160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:10.850743 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d6157b25-c07d-4a66-b0db-98bc3ed3fa9d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1510 microversion: 2.1 time: 0.200991 Apr 01 10:06:10.854507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 116/238] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:10 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1510 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:11.728240 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:11.728865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:11.735272 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:11.735727 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:11.736550 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:11.736978 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:11.799233 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:11.810387 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-52544d85-5bc9-4b81-a3f0-fccce228bd3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1266 microversion: 2.1 time: 0.087560 Apr 01 10:06:11.811287 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 123/239] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:11 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:11.875119 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:11.876169 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:11.886959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:11.887756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:11.889022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:11.889739 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:12.024614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:12.032649 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1ffb7702-bda5-4b20-9c89-6f023fefb4d1 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1516 microversion: 2.1 time: 0.164095 Apr 01 10:06:12.033225 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 117/240] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:11 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:12.830293 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:12.830943 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:12.837264 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:12.837712 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:12.838485 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:12.838944 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:12.899720 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:12.907019 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-67a67a06-57b3-42ca-878c-bda951a186bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1272 microversion: 2.1 time: 0.082587 Apr 01 10:06:12.907677 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 124/241] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:12 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1272 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:13.924652 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:13.925387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:13.933707 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:13.934406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:13.935410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:13.936134 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:14.010569 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:14.018025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c4cb8eed-220e-4031-b93f-80908879d19f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1272 microversion: 2.1 time: 0.097886 Apr 01 10:06:14.018597 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 118/242] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:13 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:15.035883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:15.037336 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:15.046532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:15.047466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:15.048435 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:15.049017 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:15.311296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:15.330996 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e69169f3-c2f7-421f-b525-696d2835d88d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.299243 Apr 01 10:06:15.332147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 125/243] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:15 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:16.349641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:16.350258 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:16.369090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:16.369915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:16.372617 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:16.373372 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:16.899299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:16.912540 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-65e174b4-dc0b-4b22-9d97-c1e190e5ff3f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.567049 Apr 01 10:06:16.914756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 119/244] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:16 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:17.727298 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-c808814d-6b3e-48bc-8e65-b3d117e2e87b req-6bbe01cb-0bf8-49fc-a6a0-114e509b4335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e", "tag": "9ac06a78-f608-46f8-af34-a99c14e40ada"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:17.741419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-c808814d-6b3e-48bc-8e65-b3d117e2e87b req-6bbe01cb-0bf8-49fc-a6a0-114e509b4335 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:17.750681 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-c808814d-6b3e-48bc-8e65-b3d117e2e87b req-6bbe01cb-0bf8-49fc-a6a0-114e509b4335 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:17.772380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-48a010cc-023b-44cf-af97-048e1d5f5e0e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'create', calling method: .version_select at 0x7f64edc4edc0>, body: {"keypair": {"name": "tempest-keypair-656976635"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:17.773328 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-c808814d-6b3e-48bc-8e65-b3d117e2e87b req-6bbe01cb-0bf8-49fc-a6a0-114e509b4335 service nova] Creating event network-changed:9ac06a78-f608-46f8-af34-a99c14e40ada for instance bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e on hv-cinder-maste Apr 01 10:06:17.783229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-c808814d-6b3e-48bc-8e65-b3d117e2e87b req-6bbe01cb-0bf8-49fc-a6a0-114e509b4335 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060132 Apr 01 10:06:17.788800 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 126/245] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:06:17.807880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-48a010cc-023b-44cf-af97-048e1d5f5e0e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for project 4073e831952c461bb6bb0e6b1137240b. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:06:17.812398 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-48a010cc-023b-44cf-af97-048e1d5f5e0e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for user 3ca94cdcf3824f56a886b757e41602dd and project 4073e831952c461bb6bb0e6b1137240b. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:06:17.934466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:17.936632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:17.955719 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:17.957597 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:17.959162 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:17.959745 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:18.195312 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-48a010cc-023b-44cf-af97-048e1d5f5e0e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for project 4073e831952c461bb6bb0e6b1137240b. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:06:18.200857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-48a010cc-023b-44cf-af97-048e1d5f5e0e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for user 3ca94cdcf3824f56a886b757e41602dd and project 4073e831952c461bb6bb0e6b1137240b. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:06:18.237612 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-48a010cc-023b-44cf-af97-048e1d5f5e0e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.470645 Apr 01 10:06:18.245435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 120/246] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:06:17 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:06:18.341128 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:18.355987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e142b493-c02b-4e16-8fb6-f80258ec35e1 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.427548 Apr 01 10:06:18.356653 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 127/247] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:17 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:06:19.374317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:19.379252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:19.389980 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:19.390390 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:19.391556 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:19.392194 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:19.723881 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:19.734071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-042757e9-6e79-4ed0-a6ac-bd5ae2be9d3c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.364653 Apr 01 10:06:19.735056 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 121/248] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:19 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:20.751355 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:20.751961 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:20.759956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:20.760405 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:20.761183 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:20.761620 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:20.997629 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:21.006677 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-91cf6c23-c656-4b8a-a51c-97d94dcd15e7 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.259204 Apr 01 10:06:21.007294 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 128/249] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:20 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:21.417626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1741499800", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "842ae9ac-afe6-4c7c-bd19-1175b1f98e37"}], "security_groups": [{"name": "tempest-securitygroup--2141575343"}], "key_name": "tempest-keypair-656976635", "user_data": "}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:21.565188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] validate_networks() for [('842ae9ac-afe6-4c7c-bd19-1175b1f98e37', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:06:22.023497 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:22.024754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:22.035561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:22.035997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:22.036777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:22.037383 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:22.188119 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:06:22.188815 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:06:22.189478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:06:22.190122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:06:22.190973 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:06:22.208232 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:22.208934 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:22.209945 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:22.210600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:22.251006 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for project 4073e831952c461bb6bb0e6b1137240b. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:06:22.265507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Getting quotas for user 3ca94cdcf3824f56a886b757e41602dd and project 4073e831952c461bb6bb0e6b1137240b. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:06:22.287321 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:06:22.289585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:06:22.377387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-603f4356-a98f-43b7-9823-8bdc0b1c1f4f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.963341 Apr 01 10:06:22.379486 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 122/250] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:06:21 2022] POST /compute/v2.1/servers => generated 409 bytes in 967 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:06:22.395479 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-419eafef-a79f-4294-8665-0cc1b143c978 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:22.397066 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-419eafef-a79f-4294-8665-0cc1b143c978 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:22.537270 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-419eafef-a79f-4294-8665-0cc1b143c978 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:22.549397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-419eafef-a79f-4294-8665-0cc1b143c978 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1245 microversion: 2.1 time: 0.161440 Apr 01 10:06:22.550489 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 123/251] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:22 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1245 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:22.653828 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:22.664243 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-37eb4cbc-d8a0-402a-9571-3ce0798ff6fd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.643667 Apr 01 10:06:22.666258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 129/252] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:22 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:23.571657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:23.572997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:23.582406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:23.584966 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:23.586543 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:23.588273 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:23.685774 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:23.687867 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:23.706344 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:23.709532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:23.711676 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:23.717131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:23.881163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:23.892226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-774934d2-1567-4c1e-a44e-3be99df8d93e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1297 microversion: 2.1 time: 0.324509 Apr 01 10:06:23.893447 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 124/253] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:23 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1297 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:24.624754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:24.644345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a59b5147-e2bd-4aaa-96f4-95e4f5f0d630 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.966072 Apr 01 10:06:24.646500 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 130/254] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:23 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:24.911427 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:24.912170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:24.922079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:24.923095 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:24.923906 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:24.926600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:25.091430 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:25.102228 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0406dc15-91e5-4170-a949-1c9baf46bf11 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1303 microversion: 2.1 time: 0.194045 Apr 01 10:06:25.103731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 125/255] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:24 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1303 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:25.665410 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:25.667276 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:25.676128 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:25.679193 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:25.680618 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:25.682189 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:26.120436 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:26.121172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:26.137787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:26.140425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:26.141297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:26.142334 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:26.143465 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:26.154699 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-95490ca4-b935-4e17-aec6-2e795f8c39ff tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.494240 Apr 01 10:06:26.155454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 131/256] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:25 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:26.818866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-29d43da0-790b-4e26-828e-c7273178bc47 req-579442ce-e762-4882-9a9a-de093122b250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e", "name": "network-vif-plugged", "status": "completed", "tag": "9ac06a78-f608-46f8-af34-a99c14e40ada"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:26.842599 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-29d43da0-790b-4e26-828e-c7273178bc47 req-579442ce-e762-4882-9a9a-de093122b250 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:26.846136 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-29d43da0-790b-4e26-828e-c7273178bc47 req-579442ce-e762-4882-9a9a-de093122b250 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:26.876520 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-29d43da0-790b-4e26-828e-c7273178bc47 req-579442ce-e762-4882-9a9a-de093122b250 service nova] Creating event network-vif-plugged:9ac06a78-f608-46f8-af34-a99c14e40ada for instance bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e on hv-cinder-maste Apr 01 10:06:26.889236 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-29d43da0-790b-4e26-828e-c7273178bc47 req-579442ce-e762-4882-9a9a-de093122b250 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074091 Apr 01 10:06:26.892645 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 132/257] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:06:27.025638 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:27.038743 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ad8d7f24-65ce-439b-ae24-183b62c6746c tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.922973 Apr 01 10:06:27.039309 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 126/258] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:26 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:06:27.175472 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:27.176502 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:27.192652 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:27.195127 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:27.196833 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:27.200632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:27.380176 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-22ee1b0f-7eec-44ca-9245-7dec81f5b55d req-523396f3-0e91-43bd-a3a2-5f04bbb5147b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff54d32-e02c-4bb8-a3a6-3aec1474f63a", "tag": "78e92c0d-8920-4d6d-86a9-c78c75d01421"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:27.394261 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-22ee1b0f-7eec-44ca-9245-7dec81f5b55d req-523396f3-0e91-43bd-a3a2-5f04bbb5147b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:27.415260 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-22ee1b0f-7eec-44ca-9245-7dec81f5b55d req-523396f3-0e91-43bd-a3a2-5f04bbb5147b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:27.469584 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-22ee1b0f-7eec-44ca-9245-7dec81f5b55d req-523396f3-0e91-43bd-a3a2-5f04bbb5147b service nova] Creating event network-changed:78e92c0d-8920-4d6d-86a9-c78c75d01421 for instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a on hv-cinder-maste Apr 01 10:06:27.476552 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-22ee1b0f-7eec-44ca-9245-7dec81f5b55d req-523396f3-0e91-43bd-a3a2-5f04bbb5147b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100215 Apr 01 10:06:27.483395 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 127/259] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:06:27.890521 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:27.923690 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-00bc6380-6ad5-4ae9-89a0-7ce26550e4b9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.750231 Apr 01 10:06:27.929493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 133/260] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:27 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:28.061374 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:28.062598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:28.083926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:28.084627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:28.085624 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:28.086383 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:28.589896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:28.602926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cdb067ab-6ba4-4998-a690-74db98c8848e tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.549985 Apr 01 10:06:28.613621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 128/261] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:28 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:28.940709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:28.942081 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:28.951587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:28.955647 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:28.958210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:28.959228 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:29.628505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:29.630153 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:29.640104 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:29.640942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:29.642494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:29.643317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:29.700873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:29.717072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-61d97186-f1cf-4b56-baf0-36e6706299a4 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1314 microversion: 2.1 time: 0.778334 Apr 01 10:06:29.717992 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 134/262] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:28 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1314 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:29.924232 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:29.937927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b6dac52e-2808-47a7-be77-7917d4f34857 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.313320 Apr 01 10:06:29.947159 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 129/263] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:29 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:30.223800 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e979dc96-58bd-4844-8bac-35f677abaae6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Action: 'create', calling method: .version_select at 0x7f64eed5c700>, body: {"keypair": {"name": "tempest-TestShelveInstance-1939095511"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:30.243831 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-e979dc96-58bd-4844-8bac-35f677abaae6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Getting quotas for project 3dc1f10cbf10469d8abe0641ae154834. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:06:30.248240 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-e979dc96-58bd-4844-8bac-35f677abaae6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Getting quotas for user 7e73b5e40fca4a40b235f934b7573f22 and project 3dc1f10cbf10469d8abe0641ae154834. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:06:30.679088 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-e979dc96-58bd-4844-8bac-35f677abaae6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Getting quotas for project 3dc1f10cbf10469d8abe0641ae154834. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:06:30.682699 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-e979dc96-58bd-4844-8bac-35f677abaae6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Getting quotas for user 7e73b5e40fca4a40b235f934b7573f22 and project 3dc1f10cbf10469d8abe0641ae154834. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:06:30.695434 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e979dc96-58bd-4844-8bac-35f677abaae6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.641510 Apr 01 10:06:30.696244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 135/264] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:06:30 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:30.733651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:30.734272 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:30.740783 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:30.741227 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:30.742112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:30.742547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:30.937588 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:30.947020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-285a8e86-e783-4252-8b5f-a8de353ad872 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1497 microversion: 2.1 time: 0.217274 Apr 01 10:06:30.957079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 130/265] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:30 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1497 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:30.957248 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:30.957248 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:30.972440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:30.972891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:30.973702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:30.974131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:31.188313 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:31.196736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4689d221-a2fe-4d1a-bc97-8d54edecc87d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.245564 Apr 01 10:06:31.197361 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 136/266] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:30 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:32.215901 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:32.217081 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:32.225847 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:32.226892 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:32.228375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:32.230287 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:32.384131 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:32.392763 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2240862c-668f-495b-9fcf-dae477130dcf tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.182717 Apr 01 10:06:32.393813 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 131/267] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:32 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:33.409807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:33.410843 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:33.417169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:33.417615 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:33.418436 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:33.418857 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:33.592147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:33.600139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-157d6a06-5611-4a66-9b51-0014fd7991a4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.194396 Apr 01 10:06:33.602474 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 137/268] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:33 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:34.015779 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:34.016282 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:34.023290 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:34.023738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:34.024530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:34.024964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:34.051878 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:06:34.150737 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-022e147a-99e8-49eb-a507-8b468c8a232f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "DELETE /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 204 len: 0 microversion: 2.1 time: 0.138405 Apr 01 10:06:34.151349 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 132/269] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:06:34 2022] DELETE /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:06:34.162571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:34.163468 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:34.173999 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:34.174457 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:34.175266 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:34.175865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:34.323854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:34.332758 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d65dfa6d-ac5c-475d-96ce-80a8fd417f37 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1503 microversion: 2.1 time: 0.175650 Apr 01 10:06:34.342684 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 138/270] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:34 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:34.616690 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:34.617633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:34.623842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:34.624284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:34.625114 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:34.625550 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:34.779393 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:34.787636 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e3efd84b-2f00-4d61-af60-d5fea05fec2a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.174916 Apr 01 10:06:34.790678 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 133/271] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:34 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:35.350098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:35.350826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:35.356703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:35.357146 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:35.357919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:35.358325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:35.520130 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:35.532474 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-55e886eb-e2f4-4fe2-8755-0ff6efc13014 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1503 microversion: 2.1 time: 0.186542 Apr 01 10:06:35.533224 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 139/272] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:35 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:35.805182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:35.805876 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:35.812744 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:35.813275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:35.814100 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:35.814538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:35.952343 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:35.959734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-afe7c10b-cc4a-4363-8160-3b75820da806 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.158559 Apr 01 10:06:35.966349 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 134/273] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:35 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:36.550752 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:36.551460 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:36.558548 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:36.559023 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:36.559797 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:36.560223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:36.815493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:36.826286 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-575b3a91-38c4-42ac-8eb6-e2a65e2c19e6 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 200 len: 1503 microversion: 2.1 time: 0.280254 Apr 01 10:06:36.830888 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-4df70c47-b667-42c7-aa6f-7a5405350914 req-4eac5c71-ce34-4602-8db8-5e3a97425f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e", "name": "network-vif-deleted", "tag": "9ac06a78-f608-46f8-af34-a99c14e40ada"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:36.837731 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 140/274] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:36 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 1503 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:36.841127 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-4df70c47-b667-42c7-aa6f-7a5405350914 req-4eac5c71-ce34-4602-8db8-5e3a97425f28 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:36.841998 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-4df70c47-b667-42c7-aa6f-7a5405350914 req-4eac5c71-ce34-4602-8db8-5e3a97425f28 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:36.854456 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-4df70c47-b667-42c7-aa6f-7a5405350914 req-4eac5c71-ce34-4602-8db8-5e3a97425f28 service nova] Creating event network-vif-deleted:9ac06a78-f608-46f8-af34-a99c14e40ada for instance bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e on hv-cinder-maste Apr 01 10:06:36.860188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-4df70c47-b667-42c7-aa6f-7a5405350914 req-4eac5c71-ce34-4602-8db8-5e3a97425f28 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032963 Apr 01 10:06:36.860796 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 135/275] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:06:36.978283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:36.979107 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:36.985617 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:36.986196 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:36.987023 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:36.987453 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:37.148559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:37.155909 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3fa71ca9-3b47-4f5f-afae-a09bbe7b90b6 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.183118 Apr 01 10:06:37.156547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 141/276] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:36 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:37.846328 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:37.850096 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:37.857049 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:37.857538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:37.858386 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:37.859035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:37.873453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] HTTP exception thrown: Instance bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e could not be found. Apr 01 10:06:37.874145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Returning 404 to user: Instance bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:06:37.875264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-69257384-7108-4c4a-8f77-90d5a5f2f9bf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e" status: 404 len: 111 microversion: 2.1 time: 0.033954 Apr 01 10:06:37.875866 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 136/277] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:37 2022] GET /compute/v2.1/servers/bf5cbfcc-a1ae-4ce2-b88c-02e54f6c532e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:06:37.975797 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1461145376", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "networks": [{"uuid": "4b05cb53-9743-4e0b-9b86-b26d0ecaecc9"}]}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:38.028665 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] validate_networks() for [('4b05cb53-9743-4e0b-9b86-b26d0ecaecc9', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:06:38.173774 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:38.174704 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:38.183146 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:38.183593 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:38.184391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:38.184826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:38.473287 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:38.495663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3d4ff6fb-05b7-457c-835c-797c69e7ee2d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.325460 Apr 01 10:06:38.495915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 137/278] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:38 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:06:38.500506 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-2d051f62-799e-43ac-ab0f-52ad373c2061 req-38bcd178-a2ee-4a8f-aed5-7ad2a7bcc2bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff54d32-e02c-4bb8-a3a6-3aec1474f63a", "name": "network-vif-plugged", "status": "completed", "tag": "78e92c0d-8920-4d6d-86a9-c78c75d01421"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:38.512015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:06:38.512670 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:06:38.513327 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:06:38.513874 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:06:38.514615 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:06:38.517251 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-2d051f62-799e-43ac-ab0f-52ad373c2061 req-38bcd178-a2ee-4a8f-aed5-7ad2a7bcc2bc service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:38.517709 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-2d051f62-799e-43ac-ab0f-52ad373c2061 req-38bcd178-a2ee-4a8f-aed5-7ad2a7bcc2bc service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:38.527763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:38.528244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:38.529350 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:38.529966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:38.530810 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-2d051f62-799e-43ac-ab0f-52ad373c2061 req-38bcd178-a2ee-4a8f-aed5-7ad2a7bcc2bc service nova] Creating event network-vif-plugged:78e92c0d-8920-4d6d-86a9-c78c75d01421 for instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a on hv-cinder-maste Apr 01 10:06:38.537237 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-2d051f62-799e-43ac-ab0f-52ad373c2061 req-38bcd178-a2ee-4a8f-aed5-7ad2a7bcc2bc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040001 Apr 01 10:06:38.538494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 138/279] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:06:38.558727 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Getting quotas for project 47d184624c1d4bae9384dc4be14343fd. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:06:38.566034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Getting quotas for user b687f70831024cac87826377235bd5a6 and project 47d184624c1d4bae9384dc4be14343fd. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:06:38.584444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:06:38.587764 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:06:38.648622 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-01941b51-30d8-43d8-9e05-85b4eb2b3894 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.676468 Apr 01 10:06:38.649978 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 142/280] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:06:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:06:38.661614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-299ad79d-64fb-45aa-abb3-85152d3a38ba tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:38.662424 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-299ad79d-64fb-45aa-abb3-85152d3a38ba tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:38.738804 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-299ad79d-64fb-45aa-abb3-85152d3a38ba tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:38.746876 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-299ad79d-64fb-45aa-abb3-85152d3a38ba tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1214 microversion: 2.1 time: 0.089414 Apr 01 10:06:38.759124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 139/281] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:38 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1214 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:39.512686 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:39.513262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:39.519600 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:39.520056 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:39.521174 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:39.521627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:39.698133 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:39.708818 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-36b9fb25-b0b5-4c87-9480-3f3f417a70f0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1371 microversion: 2.1 time: 0.200289 Apr 01 10:06:39.720927 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 143/282] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:39 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:39.777936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:39.778536 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:39.785324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:39.785770 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:39.786863 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:39.787855 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:39.881005 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:39.890544 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f8bc2eae-354b-4c91-91e5-22f702a271fc tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1274 microversion: 2.1 time: 0.117642 Apr 01 10:06:39.891195 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 140/283] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:39 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1274 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:40.728990 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:40.729607 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:40.738954 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:40.739399 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:40.747258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:40.747705 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:40.908269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:40.908873 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:40.928603 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:40.929429 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:40.930366 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:40.931456 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:40.987427 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:41.012966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c3e6bc70-7e40-4940-bfa8-273bd4786c05 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1565 microversion: 2.1 time: 0.286694 Apr 01 10:06:41.015668 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 144/284] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:40 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1565 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:41.032735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0d8b2142-1f08-44c6-ab34-0351985c90d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:41.033480 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0d8b2142-1f08-44c6-ab34-0351985c90d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:41.045244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d8b2142-1f08-44c6-ab34-0351985c90d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:41.045964 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d8b2142-1f08-44c6-ab34-0351985c90d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:41.047216 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d8b2142-1f08-44c6-ab34-0351985c90d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:41.047987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d8b2142-1f08-44c6-ab34-0351985c90d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:41.215086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:41.223019 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0d8b2142-1f08-44c6-ab34-0351985c90d0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.195299 Apr 01 10:06:41.223631 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 145/285] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:06:41 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-interface => generated 284 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:06:41.224697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-81ca2edf-e263-48ec-9b72-62b3cdc11dbf tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.320172 Apr 01 10:06:41.225262 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 141/286] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:40 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:06:41.913012 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-460713d1-738f-47bb-8a39-e11fdf0caf86 req-b29a3d10-5174-4584-9638-a6aa8885c379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "91448091-53d6-4ff0-a6f1-6b16a1e26d86", "tag": "cef90253-db28-43a4-b23a-a4a903b745c8"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:41.940277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-460713d1-738f-47bb-8a39-e11fdf0caf86 req-b29a3d10-5174-4584-9638-a6aa8885c379 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:41.940933 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-460713d1-738f-47bb-8a39-e11fdf0caf86 req-b29a3d10-5174-4584-9638-a6aa8885c379 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:41.963677 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-460713d1-738f-47bb-8a39-e11fdf0caf86 req-b29a3d10-5174-4584-9638-a6aa8885c379 service nova] Creating event network-changed:cef90253-db28-43a4-b23a-a4a903b745c8 for instance 91448091-53d6-4ff0-a6f1-6b16a1e26d86 on hv-cinder-maste Apr 01 10:06:41.980352 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-460713d1-738f-47bb-8a39-e11fdf0caf86 req-b29a3d10-5174-4584-9638-a6aa8885c379 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072388 Apr 01 10:06:41.981489 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 146/287] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:06:42.241735 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:42.242691 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:42.251539 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:42.252049 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:42.253144 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:42.253630 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:42.750338 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:42.763512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-fd020744-42ad-4eae-9385-838be8b7b09f tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.525108 Apr 01 10:06:42.785644 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 142/288] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:42 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:43.197247 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-f0a1346d-8225-42f7-82d6-590e53dc60ed req-fa220795-0c4b-4edb-bb43-d51bb8f83756 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff54d32-e02c-4bb8-a3a6-3aec1474f63a", "tag": "78e92c0d-8920-4d6d-86a9-c78c75d01421"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:43.215229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-f0a1346d-8225-42f7-82d6-590e53dc60ed req-fa220795-0c4b-4edb-bb43-d51bb8f83756 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:43.216677 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-f0a1346d-8225-42f7-82d6-590e53dc60ed req-fa220795-0c4b-4edb-bb43-d51bb8f83756 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:43.240711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-f0a1346d-8225-42f7-82d6-590e53dc60ed req-fa220795-0c4b-4edb-bb43-d51bb8f83756 service nova] Creating event network-changed:78e92c0d-8920-4d6d-86a9-c78c75d01421 for instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a on hv-cinder-maste Apr 01 10:06:43.253979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-f0a1346d-8225-42f7-82d6-590e53dc60ed req-fa220795-0c4b-4edb-bb43-d51bb8f83756 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060516 Apr 01 10:06:43.256091 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 147/289] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:06:43.785116 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:43.785116 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:43.793999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:43.794874 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:43.795917 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:43.796689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:44.040115 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:44.053942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-44448206-622c-4e8e-aa71-4c73690d3262 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.273129 Apr 01 10:06:44.057203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 143/290] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:43 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:45.074029 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:45.074742 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:45.080970 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:45.081416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:45.082173 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:45.082597 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:45.217274 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:45.225757 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0a777ebd-6568-4152-83d3-70ca295ec17b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.155988 Apr 01 10:06:45.226377 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 148/291] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:45 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:46.243375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:46.243985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:46.250349 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:46.250499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:46.251196 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:46.251637 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:46.400253 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:46.408327 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-180c2aee-d6d9-4f19-a83c-2dcbdc795927 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.169172 Apr 01 10:06:46.408898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 144/292] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:46 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:47.424899 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:47.425534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:47.432005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:47.432489 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:47.433271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:47.433704 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:47.568221 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:47.576281 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9667e93b-6f5c-49ca-b97e-bee45383238e tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.155394 Apr 01 10:06:47.576848 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 149/293] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:47 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:48.598028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:48.626708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:48.626708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:48.626708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:48.626708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:48.627122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:48.766498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:48.776869 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-afd80faf-3358-49f2-a6cb-25fe78188af3 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.185336 Apr 01 10:06:48.777697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 145/294] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:48 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:49.797296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:49.797936 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:49.804481 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:49.804932 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:49.805701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:49.806132 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:49.953920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:49.961695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-23e67a4b-da37-40dc-a408-430be2a19192 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.168507 Apr 01 10:06:49.962258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 150/295] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:49 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:50.983450 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:50.984479 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:50.995319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:50.995965 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:50.997225 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:50.997949 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:51.139520 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:51.150704 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9cee271a-e6d1-4f75-9e60-66ea5a38e29a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.173549 Apr 01 10:06:51.151542 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 146/296] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:50 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:52.171190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:52.171759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:52.178384 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:52.178863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:52.179724 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:52.180148 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:52.327423 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:52.335782 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-01ba6254-ac37-4979-b9c2-4f146d6c4c0c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.168507 Apr 01 10:06:52.336393 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 151/297] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:52 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:53.353062 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:53.353664 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:53.360120 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:53.360567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:53.361322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:53.361777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:53.504033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:53.511329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-450cfbde-e675-4f4d-83c8-008e2bfb2f2b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.162152 Apr 01 10:06:53.511913 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 147/298] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:53 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:54.349384 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-47dbb2a7-a867-442b-aac8-269a48684a2d req-e5c8baf8-94f2-445f-a333-9eebb82b84c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91448091-53d6-4ff0-a6f1-6b16a1e26d86", "name": "network-vif-plugged", "status": "completed", "tag": "cef90253-db28-43a4-b23a-a4a903b745c8"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:06:54.374776 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-47dbb2a7-a867-442b-aac8-269a48684a2d req-e5c8baf8-94f2-445f-a333-9eebb82b84c4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:54.375293 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-47dbb2a7-a867-442b-aac8-269a48684a2d req-e5c8baf8-94f2-445f-a333-9eebb82b84c4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:54.391303 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-47dbb2a7-a867-442b-aac8-269a48684a2d req-e5c8baf8-94f2-445f-a333-9eebb82b84c4 service nova] Creating event network-vif-plugged:cef90253-db28-43a4-b23a-a4a903b745c8 for instance 91448091-53d6-4ff0-a6f1-6b16a1e26d86 on hv-cinder-maste Apr 01 10:06:54.396954 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-47dbb2a7-a867-442b-aac8-269a48684a2d req-e5c8baf8-94f2-445f-a333-9eebb82b84c4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053169 Apr 01 10:06:54.397826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 152/299] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:06:54.528309 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:54.528940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:54.535238 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:54.535700 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:54.536476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:54.536919 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:54.676477 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:54.687968 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9938c009-6921-4ca2-b5f7-82a32d60251c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.163440 Apr 01 10:06:54.688769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 148/300] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:54 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:55.710387 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:55.711230 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:55.718005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:55.718454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:55.719234 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:55.719657 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:55.863566 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:55.871468 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-635bf89b-1fd6-410c-ad3e-22421fba2bbd tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.167949 Apr 01 10:06:55.872016 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 153/301] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:55 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:56.897668 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:56.898693 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:56.909315 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:56.910060 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:56.911375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:56.912083 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:57.048539 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:57.056351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4b12f6cf-b36a-47ca-a61a-f0aecfa53607 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.165449 Apr 01 10:06:57.056906 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 149/302] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:56 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:58.077436 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:58.078444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:58.087807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:58.088239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:58.089019 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:58.089448 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:58.238842 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:58.247160 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-70ee6270-92d1-4b41-92a0-bdd361374da5 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.176533 Apr 01 10:06:58.247764 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 154/303] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:58 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:06:59.268371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:06:59.269350 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:06:59.280605 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:59.281348 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:59.282579 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:06:59.283380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:06:59.429149 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:06:59.437449 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9f279771-db87-452c-97ec-e281749370f9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.175610 Apr 01 10:06:59.438032 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 150/304] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:06:59 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:00.458723 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:00.459728 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:00.467275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:00.467773 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:00.468622 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:00.469100 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:00.608751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:00.616595 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0ade3072-2676-4997-b854-e9546a4cdb02 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.164363 Apr 01 10:07:00.617463 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 155/305] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:00 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:01.638430 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:01.639497 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:01.650033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:01.650477 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:01.651274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:01.651704 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:01.785498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:01.796854 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0770ad38-b073-4289-8411-b57909147110 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.164931 Apr 01 10:07:01.797654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 151/306] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:01 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:02.818143 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:02.818778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:02.824902 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:02.825345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:02.826098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:02.826550 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:02.963563 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:02.971089 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fa30eb24-dcea-4943-8868-df0014879ae0 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.157422 Apr 01 10:07:02.971648 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 156/307] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:02 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:03.988097 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:03.989268 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:03.996065 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:03.996513 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:03.997248 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:03.997756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:04.142339 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:04.150391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8a4af5db-f426-44fc-a688-b44176ba2439 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.166444 Apr 01 10:07:04.150973 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 152/308] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:03 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:05.170205 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:05.171204 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:05.181630 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:05.182369 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:05.183671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:05.184376 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:05.331141 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:05.339490 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-db1d83cc-2564-42ba-8cad-c05b1136851c tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.175798 Apr 01 10:07:05.340065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 157/309] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:05 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:06.360666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:06.361684 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:06.370625 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:06.371236 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:06.371978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:06.372515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:06.506984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:06.514754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c3d3adb1-d369-426b-8e99-cf72b0fa2774 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1314 microversion: 2.1 time: 0.160656 Apr 01 10:07:06.515319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 153/310] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:06 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:07.531847 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:07.532476 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:07.538304 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:07.538786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:07.539664 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:07.540177 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:07.675976 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:07.683669 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b35523e4-c277-4f33-b06a-484aa518516b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1497 microversion: 2.1 time: 0.155567 Apr 01 10:07:07.684235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 158/311] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:07 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1497 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:08.151371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:08.151856 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:08.158701 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:08.159163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:08.159997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:08.160439 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:08.185371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:07:08.262496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-62e8e15d-f093-4315-90d6-61f906872c5b tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "DELETE /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 204 len: 0 microversion: 2.1 time: 0.114728 Apr 01 10:07:08.263165 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 154/312] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:07:08 2022] DELETE /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:07:08.272166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:08.272775 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:08.279112 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:08.279589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:08.280361 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:08.280790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:08.413438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:08.420669 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d44308a7-c6a3-49d1-88fa-b687bc567fb9 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1503 microversion: 2.1 time: 0.153123 Apr 01 10:07:08.421235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 159/313] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:08 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:09.442933 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:09.444075 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:09.451801 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:09.452255 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:09.453026 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:09.453457 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:09.588451 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:09.596365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2538cdc9-5fb6-4e7e-8686-37c4e62f039d tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1503 microversion: 2.1 time: 0.160486 Apr 01 10:07:09.596932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 155/314] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:09 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:10.613985 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:10.614544 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:10.620990 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:10.621432 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:10.622190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:10.622617 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:10.850341 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b687f70831024cac87826377235bd5a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47d184624c1d4bae9384dc4be14343fd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:10.857829 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-eab2a178-10f1-415a-a1ad-ea304f4db096 tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 200 len: 1503 microversion: 2.1 time: 0.247966 Apr 01 10:07:10.868716 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 160/315] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:10 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:10.948103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-722ebcc0-3097-4811-80e2-2152d427250f req-d9eb7185-ddd0-4a0b-acd0-2018b78f5420 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "91448091-53d6-4ff0-a6f1-6b16a1e26d86", "name": "network-vif-deleted", "tag": "cef90253-db28-43a4-b23a-a4a903b745c8"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:10.958368 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-722ebcc0-3097-4811-80e2-2152d427250f req-d9eb7185-ddd0-4a0b-acd0-2018b78f5420 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:10.958957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-722ebcc0-3097-4811-80e2-2152d427250f req-d9eb7185-ddd0-4a0b-acd0-2018b78f5420 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:10.977232 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-722ebcc0-3097-4811-80e2-2152d427250f req-d9eb7185-ddd0-4a0b-acd0-2018b78f5420 service nova] Creating event network-vif-deleted:cef90253-db28-43a4-b23a-a4a903b745c8 for instance 91448091-53d6-4ff0-a6f1-6b16a1e26d86 on hv-cinder-maste Apr 01 10:07:10.982231 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-722ebcc0-3097-4811-80e2-2152d427250f req-d9eb7185-ddd0-4a0b-acd0-2018b78f5420 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038268 Apr 01 10:07:10.983107 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 156/316] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:07:11.382332 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-520426133", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1939095511", "security_groups": [{"name": "tempest-secgroup-smoke-2039579652"}], "networks": [{"uuid": "f66dbf81-08fc-4982-9dd7-2742d5b5864a"}], "block_device_mapping_v2": [{"uuid": "eccb156d-4263-473e-8f96-2d94755fd994", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:11.494044 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] validate_networks() for [('f66dbf81-08fc-4982-9dd7-2742d5b5864a', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:07:11.874469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:07:11.875105 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:07:11.875379 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:07:11.875790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:07:11.876029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:11.876172 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:07:11.876719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] [instance: 91448091-53d6-4ff0-a6f1-6b16a1e26d86] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:11.883097 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:11.883651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:11.884462 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:11.884900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:11.885809 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:11.886262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:11.887099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:11.887536 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:11.898216 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] HTTP exception thrown: Instance 91448091-53d6-4ff0-a6f1-6b16a1e26d86 could not be found. Apr 01 10:07:11.898827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] Returning 404 to user: Instance 91448091-53d6-4ff0-a6f1-6b16a1e26d86 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:07:11.899639 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c0e5db47-ffc0-44f3-b74b-c78188751b6a tempest-VolumesActionsTest-61963871 tempest-VolumesActionsTest-61963871-project] 10.222.0.46 "GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86" status: 404 len: 111 microversion: 2.1 time: 0.028084 Apr 01 10:07:11.900647 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 157/317] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:11 2022] GET /compute/v2.1/servers/91448091-53d6-4ff0-a6f1-6b16a1e26d86 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:07:11.904298 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Getting quotas for project 3dc1f10cbf10469d8abe0641ae154834. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:07:11.908195 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Getting quotas for user 7e73b5e40fca4a40b235f934b7573f22 and project 3dc1f10cbf10469d8abe0641ae154834. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:07:11.967919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:07:11.970263 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='eccb156d-4263-473e-8f96-2d94755fd994',volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:07:12.150464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3e664202-2d82-41bc-ae51-d227a4071859 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.771951 Apr 01 10:07:12.151589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 161/318] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:07:11 2022] POST /compute/v2.1/servers => generated 406 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:07:12.161450 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0a68d4a3-9dc7-4e8b-9a2e-ecac4921607a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:12.161992 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0a68d4a3-9dc7-4e8b-9a2e-ecac4921607a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:12.232983 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0a68d4a3-9dc7-4e8b-9a2e-ecac4921607a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:12.241416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0a68d4a3-9dc7-4e8b-9a2e-ecac4921607a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1088 microversion: 2.1 time: 0.083936 Apr 01 10:07:12.255141 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 158/319] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:12 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1088 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:13.261260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:13.261849 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:13.268790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:13.269451 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:13.270441 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:13.270894 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:13.331639 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:13.338950 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fb6afdaa-1425-4912-969c-4450a9dcb41b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1186 microversion: 2.1 time: 0.081558 Apr 01 10:07:13.344857 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 162/320] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:13 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1186 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:14.357475 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:14.358196 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:14.365871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:14.366468 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:14.367541 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:14.368261 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:14.445582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:14.453886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-47fa00eb-98c4-4ae4-b75e-cce168048583 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1204 microversion: 2.1 time: 0.102125 Apr 01 10:07:14.454432 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 159/321] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:14 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1204 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:15.471696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:15.472998 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:15.479549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:15.480236 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:15.482415 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:15.482951 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:15.543739 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:15.551334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-afe38376-7dce-4b2c-bd70-fe8ee99eb08a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1204 microversion: 2.1 time: 0.083916 Apr 01 10:07:15.552234 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 163/322] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:15 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1204 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:16.567828 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:16.569106 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:16.575257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:16.575952 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:16.576964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:16.577580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:16.647652 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:16.655334 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-422b2816-39a0-4342-a71a-a179118cc4b6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1204 microversion: 2.1 time: 0.091609 Apr 01 10:07:16.656039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 160/323] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:16 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1204 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:17.675059 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:17.675751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:17.683532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:17.684323 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:17.686416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:17.687129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:17.780000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:17.789467 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8ca85907-09cd-49b1-8829-304d9ecbfd03 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1204 microversion: 2.1 time: 0.120636 Apr 01 10:07:17.790060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 164/324] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:17 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1204 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:18.807638 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:18.809744 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:18.834044 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:18.834496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:18.836952 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:18.842273 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:18.862097 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-5d153681-7113-4679-8887-3d31c036449a req-ab9846db-2583-41fb-a7d0-59cc7dd0e4c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50585cb5-8edf-45ce-833d-3109010a299e", "tag": "8b587726-e35f-40ca-8c0d-3c4d86c794ce"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:18.886141 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5d153681-7113-4679-8887-3d31c036449a req-ab9846db-2583-41fb-a7d0-59cc7dd0e4c5 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:18.888484 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5d153681-7113-4679-8887-3d31c036449a req-ab9846db-2583-41fb-a7d0-59cc7dd0e4c5 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:18.907179 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-5d153681-7113-4679-8887-3d31c036449a req-ab9846db-2583-41fb-a7d0-59cc7dd0e4c5 service nova] Creating event network-changed:8b587726-e35f-40ca-8c0d-3c4d86c794ce for instance 50585cb5-8edf-45ce-833d-3109010a299e on hv-cinder-maste Apr 01 10:07:18.918253 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-5d153681-7113-4679-8887-3d31c036449a req-ab9846db-2583-41fb-a7d0-59cc7dd0e4c5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062627 Apr 01 10:07:18.919708 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 165/325] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:07:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:07:19.472319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:19.496414 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-37cd512a-4f53-4b89-aa01-dc5abb8f9725 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1272 microversion: 2.1 time: 0.689929 Apr 01 10:07:19.509018 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 161/326] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:18 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1272 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:20.512866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:20.513860 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:20.539987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:20.540450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:20.541226 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:20.541657 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:21.253650 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:21.262709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0e3f81f1-a290-4159-8595-85a54e0724f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.753875 Apr 01 10:07:21.270389 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 166/327] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:20 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 763 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:22.287872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:22.289535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:22.305142 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:22.305787 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:22.306896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:22.307542 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:22.867584 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:22.877473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6240c438-f0df-45f8-a71e-fde2b6b7be64 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.593882 Apr 01 10:07:22.879004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 162/328] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:22 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:23.898720 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:23.900030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:23.913032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:23.913676 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:23.918804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:23.921147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:24.593237 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:24.606751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b59c9ee2-9faf-4f8c-a184-c6b809cf93de tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.713017 Apr 01 10:07:24.613683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 167/329] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:23 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:25.629915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:25.630538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:25.646305 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:25.647190 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:25.648726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:25.649528 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:26.101792 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:26.111278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1a5895dd-964e-4d98-9c15-f22f68c4c6bd tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.485085 Apr 01 10:07:26.112703 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 163/330] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:25 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:27.131289 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:27.132709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:27.141415 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:27.142286 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:27.143669 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:27.145066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:27.434989 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:27.444290 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7232af04-2265-44b6-808c-bb245dec49f8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.317437 Apr 01 10:07:27.455854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 168/331] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:27 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:28.475432 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:28.476759 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:28.498622 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:28.499392 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:28.502228 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:28.502938 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:28.728942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:28.759064 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0e45ea01-73ea-4b60-8681-84509480711b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.297500 Apr 01 10:07:28.759921 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 164/332] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:28 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:29.777508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:29.778808 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:29.788647 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:29.790465 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:29.795916 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:29.796597 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:30.093378 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:30.115048 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e1ed060d-b6ee-49b3-84a4-30d4fa071d7f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.338851 Apr 01 10:07:30.116453 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 169/333] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:29 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:31.139509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:31.140898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:31.159669 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:31.162291 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:31.166180 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:31.168752 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:31.534576 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:31.542552 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-21f72f42-fa90-4f5d-a8a4-47cd0c9fc95c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.413069 Apr 01 10:07:31.551566 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 165/334] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:31 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:32.559444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:32.561290 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:32.575931 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:32.576417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:32.578037 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:32.580891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:32.934611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:32.943446 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9e5b989e-2bbf-479e-bdfb-39e2d3116931 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.388251 Apr 01 10:07:32.948804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 170/335] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:32 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:33.966198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:33.967372 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:33.982008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:33.982570 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:33.983448 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:33.989103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:34.362928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:34.378678 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3e181da3-c230-4f13-9993-5a4eb548a1c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.413136 Apr 01 10:07:34.378678 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 166/336] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:33 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:34.722291 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-56418d62-48e5-4740-9e6f-bf05b2982cb6 req-07c52a4d-28bb-4e48-ae13-6f4c097490b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50585cb5-8edf-45ce-833d-3109010a299e", "name": "network-vif-plugged", "status": "completed", "tag": "8b587726-e35f-40ca-8c0d-3c4d86c794ce"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:34.738014 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-56418d62-48e5-4740-9e6f-bf05b2982cb6 req-07c52a4d-28bb-4e48-ae13-6f4c097490b0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:34.751527 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-56418d62-48e5-4740-9e6f-bf05b2982cb6 req-07c52a4d-28bb-4e48-ae13-6f4c097490b0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:34.782068 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-56418d62-48e5-4740-9e6f-bf05b2982cb6 req-07c52a4d-28bb-4e48-ae13-6f4c097490b0 service nova] Creating event network-vif-plugged:8b587726-e35f-40ca-8c0d-3c4d86c794ce for instance 50585cb5-8edf-45ce-833d-3109010a299e on hv-cinder-maste Apr 01 10:07:34.795720 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-56418d62-48e5-4740-9e6f-bf05b2982cb6 req-07c52a4d-28bb-4e48-ae13-6f4c097490b0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078869 Apr 01 10:07:34.796593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 171/337] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:07:35.398734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:35.399844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:35.441732 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:35.442469 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:35.449000 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:35.449194 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:35.843843 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:35.861481 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-98568790-be46-4497-ad25-1bb853aba11e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.473329 Apr 01 10:07:35.862461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 167/338] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:35 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:36.889768 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:36.890607 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:36.904285 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:36.904753 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:36.905570 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:36.906005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:37.140646 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:37.164620 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f4fb2531-5832-4ec4-9dbc-70bce916947e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1260 microversion: 2.1 time: 0.287205 Apr 01 10:07:37.166071 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 172/339] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:36 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1260 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:38.187252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:38.188645 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:38.198751 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:38.199944 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:38.201777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:38.202490 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:38.393218 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:38.402252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e2796a26-bf48-41fe-9523-4a4145a43d31 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1444 microversion: 2.1 time: 0.219856 Apr 01 10:07:38.403496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 168/340] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:38 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1444 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:38.422752 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:38.430080 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:38.437540 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:38.438196 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:38.439194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:38.439776 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:38.728284 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:38.737223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-26a61569-1926-4bc4-841f-eea262c6140c tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1444 microversion: 2.1 time: 0.318402 Apr 01 10:07:38.739817 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 173/341] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:38 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1444 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:40.574242 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a3d642a5-f3f5-4ca0-853c-be77afb573f9 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Action: 'create', calling method: .version_select at 0x7f64edad5dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-650435568"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:40.602509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-a3d642a5-f3f5-4ca0-853c-be77afb573f9 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Getting quotas for project c4a61874308747efa6cf0456be5f46b6. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:07:40.606827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-a3d642a5-f3f5-4ca0-853c-be77afb573f9 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Getting quotas for user 865b26ccfed74865b856e8c3d33e3574 and project c4a61874308747efa6cf0456be5f46b6. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:07:40.839745 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-a3d642a5-f3f5-4ca0-853c-be77afb573f9 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Getting quotas for project c4a61874308747efa6cf0456be5f46b6. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:07:40.845192 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-a3d642a5-f3f5-4ca0-853c-be77afb573f9 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Getting quotas for user 865b26ccfed74865b856e8c3d33e3574 and project c4a61874308747efa6cf0456be5f46b6. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:07:40.863361 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a3d642a5-f3f5-4ca0-853c-be77afb573f9 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2321 microversion: 2.1 time: 0.294784 Apr 01 10:07:40.864581 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 169/342] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:07:40 2022] POST /compute/v2.1/os-keypairs => generated 2321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:40.985517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-382173218", "imageRef": "fc2ae866-e05e-4a7f-8e54-54c9b52612ce", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-650435568", "networks": [{"uuid": "14459437-c706-451f-927f-55b2ace8385b"}]}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:41.057573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] validate_networks() for [('14459437-c706-451f-927f-55b2ace8385b', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:07:41.474878 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-10aec7ba-d76e-4fa6-829e-39b359b8d3dc req-49fa1ece-da0b-454e-8b3e-c80aa1ae676a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50585cb5-8edf-45ce-833d-3109010a299e", "tag": "8b587726-e35f-40ca-8c0d-3c4d86c794ce"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:41.492284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-10aec7ba-d76e-4fa6-829e-39b359b8d3dc req-49fa1ece-da0b-454e-8b3e-c80aa1ae676a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:41.492869 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-10aec7ba-d76e-4fa6-829e-39b359b8d3dc req-49fa1ece-da0b-454e-8b3e-c80aa1ae676a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:41.514738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-10aec7ba-d76e-4fa6-829e-39b359b8d3dc req-49fa1ece-da0b-454e-8b3e-c80aa1ae676a service nova] Creating event network-changed:8b587726-e35f-40ca-8c0d-3c4d86c794ce for instance 50585cb5-8edf-45ce-833d-3109010a299e on hv-cinder-maste Apr 01 10:07:41.520509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-10aec7ba-d76e-4fa6-829e-39b359b8d3dc req-49fa1ece-da0b-454e-8b3e-c80aa1ae676a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055672 Apr 01 10:07:41.524705 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 170/343] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:07:41.590612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:07:41.591712 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:07:41.592740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:07:41.593466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:07:41.594285 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:07:41.606589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:41.607337 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:41.608416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:41.609006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:41.630580 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Getting quotas for project c4a61874308747efa6cf0456be5f46b6. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:07:41.639113 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Getting quotas for user 865b26ccfed74865b856e8c3d33e3574 and project c4a61874308747efa6cf0456be5f46b6. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:07:41.655082 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:07:41.658525 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='fc2ae866-e05e-4a7f-8e54-54c9b52612ce',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:07:41.729649 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cc8e1a8d-2219-41a1-b3dc-ad23e1fb47ae tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.749679 Apr 01 10:07:41.731225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 174/344] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:07:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 753 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:07:41.744550 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f0a189bd-a2eb-416e-87cc-10781372e674 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:41.746556 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f0a189bd-a2eb-416e-87cc-10781372e674 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:41.831116 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f0a189bd-a2eb-416e-87cc-10781372e674 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:41.842875 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f0a189bd-a2eb-416e-87cc-10781372e674 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1257 microversion: 2.1 time: 0.105497 Apr 01 10:07:41.844583 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 171/345] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:41 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1257 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:07:42.859980 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:42.860590 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:42.866979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:42.867569 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:42.868386 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:42.868818 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:42.932696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:42.940749 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f8d6eb69-7330-4646-9deb-61a30b5b916e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1309 microversion: 2.1 time: 0.084694 Apr 01 10:07:42.941312 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 175/346] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:42 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1309 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:43.389390 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-96d77e41-2b20-44c9-8988-c5cd8a05fc1d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:43.390002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-96d77e41-2b20-44c9-8988-c5cd8a05fc1d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:43.398281 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96d77e41-2b20-44c9-8988-c5cd8a05fc1d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:43.398773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96d77e41-2b20-44c9-8988-c5cd8a05fc1d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:43.399557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96d77e41-2b20-44c9-8988-c5cd8a05fc1d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:43.399991 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96d77e41-2b20-44c9-8988-c5cd8a05fc1d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:43.424743 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-96d77e41-2b20-44c9-8988-c5cd8a05fc1d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/ips" status: 200 len: 152 microversion: 2.20 time: 0.039362 Apr 01 10:07:43.425541 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 172/347] 10.222.0.46 () {60 vars in 1288 bytes} [Fri Apr 1 10:07:43 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:07:43.959223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:43.960650 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:43.975602 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:43.976893 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:43.983740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:43.987124 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:44.085276 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:44.096483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-df28a203-2129-4a39-8ea5-bfe6226854d5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1315 microversion: 2.1 time: 0.142831 Apr 01 10:07:44.097677 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 176/348] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:43 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:45.114672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:45.115894 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:45.131885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:45.131885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:45.131885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:45.131885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:45.265720 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:45.273829 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-86510cb6-d3c1-4e23-b1b2-53e0e9b92f7f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.163376 Apr 01 10:07:45.274398 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 173/349] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:45 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:46.082813 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:07:46.084086 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:46.090722 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:46.091464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:46.092515 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:46.093015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:46.116589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.objects.instance [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lazy-loading 'flavor' on Instance uuid f0c911a2-ef42-4d2a-bea9-a6c56575559f {{(pid=117066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:07:46.292880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:46.293755 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:46.301138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:46.301896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:46.302915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:46.303759 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:46.456248 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-313701a5-3b90-4fbe-9999-c884cf64207d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/action" status: 202 len: 0 microversion: 2.20 time: 0.376362 Apr 01 10:07:46.462059 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 177/350] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 1 10:07:46 2022] POST /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/action => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:07:46.473905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:46.478840 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:46.486860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:46.495657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f87754d2-5af9-4619-a38b-e4c6f29adf7a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.207813 Apr 01 10:07:46.496814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 174/351] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:46 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:07:46.499080 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:46.499755 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:46.500740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:46.501169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:46.714375 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:46.724974 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:46.727002 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:46.728654 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5070fd55-1e5b-4731-8376-bf45332cab98 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.264636 Apr 01 10:07:46.729777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 178/352] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:46 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:47.512731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:47.513476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:47.520497 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:47.520944 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:47.521704 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:47.522125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:47.687952 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:47.696423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0f91d2c3-0800-4c72-b031-0af45200c4f7 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.187536 Apr 01 10:07:47.697012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 175/353] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:47 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:47.748018 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:47.749415 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:47.755991 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:47.756800 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:47.757748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:47.758242 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:47.923707 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:47.936848 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:47.938380 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:47.939579 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-add0cdbf-0a98-4790-91c4-61d791733d80 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.195523 Apr 01 10:07:47.940135 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 179/354] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:47 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:48.714058 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:48.714795 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:48.722858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:48.723740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:48.724511 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:48.724947 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:48.866371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:48.874412 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-37a898b6-0d32-467e-b7c1-0cd554f64b71 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.164726 Apr 01 10:07:48.875035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 176/355] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:48 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:48.960994 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:48.962591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:48.969377 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:48.969781 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:48.970560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:48.971038 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:49.120025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:49.129159 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:49.130703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:49.132040 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-71c76446-46b9-4bb9-8615-6f59df371dc8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.175800 Apr 01 10:07:49.132599 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 180/356] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:48 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:49.892137 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:49.892894 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:49.899780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:49.900223 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:49.901004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:49.901441 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:50.046060 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:50.054498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-50a43d97-cfe1-4146-9f6d-166a54145e50 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.166397 Apr 01 10:07:50.055136 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 177/357] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:49 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:50.150875 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:50.151551 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:50.158032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:50.158482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:50.159303 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:50.159734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:50.327200 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:50.335417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:50.336963 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:50.338118 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8f497688-c5ee-485b-8981-882e6724f612 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.191452 Apr 01 10:07:50.338688 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 181/358] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:50 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:51.072653 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:51.074163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:51.083336 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:51.083771 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:51.084585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:51.085052 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:51.220656 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:51.228889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a9960a08-315e-4b0f-bd2a-fa426d3573ce tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.160688 Apr 01 10:07:51.229461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 178/359] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:51 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:51.358554 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:51.359375 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:51.365888 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:51.366338 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:51.367136 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:51.367571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:51.503635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:51.512646 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:51.514428 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:51.515731 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2e28a703-4ac1-44b5-896e-8baf358a25a2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.162722 Apr 01 10:07:51.524395 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 182/360] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:51 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:52.247618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:52.249402 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:52.257474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:52.258507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:52.259473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:52.260125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:52.400632 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:52.410318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6be184b1-3839-4e89-9134-e36fd9577001 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.167634 Apr 01 10:07:52.411732 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 179/361] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:52 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:52.538541 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:52.539495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:52.549666 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:52.550375 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:52.551759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:52.552477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:52.696678 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:52.705297 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:52.706777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:52.707978 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8458ca0e-54de-457b-b4d9-734505ddbcc0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.176268 Apr 01 10:07:52.708768 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 183/362] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:52 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:53.429021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:53.429701 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:53.437080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:53.437545 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:53.438307 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:53.438788 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:53.572756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:53.580922 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3503b538-6942-4c2e-9fb0-a1e361a670e3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.155848 Apr 01 10:07:53.590380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 180/363] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:53 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:53.727270 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:53.727965 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:53.734863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:53.735325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:53.739103 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:53.739569 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:53.877599 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:53.886240 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:53.887694 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:53.888903 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fcecf288-fc1b-4573-abf1-e690aad25e8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.165756 Apr 01 10:07:53.889474 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 184/364] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:53 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:54.597948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:54.598617 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:54.605502 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:54.605954 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:54.606765 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:54.607203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:54.745795 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:54.753017 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-721a3221-128a-47a4-9ea5-6adbe850cb8b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.159187 Apr 01 10:07:54.753580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 181/365] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:54 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:54.908167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:54.908892 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:54.915246 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:54.915689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:54.916426 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:54.917082 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:55.052766 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:55.061858 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:55.063608 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:55.064845 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a2b5d995-d30e-4049-8dbb-5645e5269e3a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.160695 Apr 01 10:07:55.065402 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 185/366] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:54 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:55.361657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-af130013-6e7d-434f-9419-c0ee696a4e9c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:55.362188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-af130013-6e7d-434f-9419-c0ee696a4e9c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:55.368105 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-af130013-6e7d-434f-9419-c0ee696a4e9c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:55.368556 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-af130013-6e7d-434f-9419-c0ee696a4e9c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:55.369322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-af130013-6e7d-434f-9419-c0ee696a4e9c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:55.369763 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-af130013-6e7d-434f-9419-c0ee696a4e9c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:55.391864 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-af130013-6e7d-434f-9419-c0ee696a4e9c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/ips" status: 200 len: 146 microversion: 2.1 time: 0.034096 Apr 01 10:07:55.393142 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 182/367] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:07:55 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/ips => generated 146 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:07:55.770004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:55.770511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:55.777409 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:55.777868 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:55.778664 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:55.779236 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:55.917787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:55.925187 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cee9abd2-e4a6-4f56-922c-63875fb02267 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.159714 Apr 01 10:07:55.925758 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 186/368] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:55 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:56.083354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:56.083940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:56.090281 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:56.090783 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:56.091537 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:56.091971 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:56.242772 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:56.250468 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:56.252028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:56.253189 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e1ee961b-6121-4604-b732-999a663be9cd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.173867 Apr 01 10:07:56.253762 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 183/369] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:56 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:56.946540 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:56.947302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:56.955558 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:56.956121 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:56.957077 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:56.957620 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:57.097887 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:57.105762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ce09b4c6-854e-43ac-9476-dc780c524fcd tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.165982 Apr 01 10:07:57.106310 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 187/370] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:56 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:57.275227 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:57.275825 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:57.282944 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:57.283397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:57.284158 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:57.284610 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:57.417026 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:57.424889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:57.426376 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:57.427548 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d0f6b67d-e8b0-4d07-bdfd-8f99effa31e0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.159206 Apr 01 10:07:57.428116 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 184/371] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:57 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:58.124037 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:58.124610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:58.131117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:58.131561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:58.132320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:58.132741 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:58.272834 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:58.280493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7af597e7-4f8f-456b-a45b-2cafaa7e1ec2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.160467 Apr 01 10:07:58.281057 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 188/372] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:58 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:58.449706 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:58.450694 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:58.461449 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:58.462207 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:58.463535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:58.464254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:58.605948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:58.614006 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:58.615538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:58.616700 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-30dbab7a-13ea-46c4-bb20-4c7e8426b6e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.173733 Apr 01 10:07:58.617271 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 185/373] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:58 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:07:59.299145 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:59.299872 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:59.307542 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:59.308000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:59.308787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:59.309286 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:59.443119 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:59.450499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3e748c53-fb2b-4527-969a-0658c9a45f51 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.156406 Apr 01 10:07:59.451107 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 189/374] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:07:59 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:07:59.637767 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:07:59.638415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:07:59.645479 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:59.645934 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:59.646736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:07:59.647175 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:07:59.791958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:59.800138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:59.801643 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:07:59.802837 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3c2a97f9-7909-4b32-b257-e1b11e416f07 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.169858 Apr 01 10:07:59.803401 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 186/375] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:07:59 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:00.471675 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:00.472702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:00.481926 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:00.482384 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:00.483212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:00.483649 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:00.627719 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:00.635396 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-06a9c74f-8eb8-49d8-bc02-4bc03cd643b3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.170303 Apr 01 10:08:00.635968 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 190/376] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:00 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:00.825353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:00.826313 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:00.837300 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:00.838054 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:00.839129 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:00.839569 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:00.971459 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:00.983583 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:00.985884 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:00.987692 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a5a2e46e-d39e-4447-8f87-3d410124b672 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.168778 Apr 01 10:08:00.988478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 187/377] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:00 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:01.657057 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:01.658362 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:01.664979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:01.665577 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:01.666369 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:01.666846 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:01.945994 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:01.954675 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c3bc8bd0-d34e-4dae-a4bb-cd71cab4ecbf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.303745 Apr 01 10:08:01.955379 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 191/378] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:01 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:02.008645 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:02.009219 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:02.015927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:02.016377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:02.017142 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:02.017571 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:02.161436 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:02.170528 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:02.172896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:02.176034 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7a36baa1-de26-4c5e-9113-60b47e0588ba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.171360 Apr 01 10:08:02.176604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 188/379] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:02 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:02.331537 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-186098d8-220f-4246-96bb-413ea4f08b2c req-135c085f-f571-4880-ab12-4706169a77a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796459f-876f-4f0b-b0b1-aa45dbf9fabe", "tag": "16f31c6b-b8cc-44ef-b38c-0325cd60edfc"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:02.340084 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-186098d8-220f-4246-96bb-413ea4f08b2c req-135c085f-f571-4880-ab12-4706169a77a6 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:02.340519 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-186098d8-220f-4246-96bb-413ea4f08b2c req-135c085f-f571-4880-ab12-4706169a77a6 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:02.359139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-186098d8-220f-4246-96bb-413ea4f08b2c req-135c085f-f571-4880-ab12-4706169a77a6 service nova] Creating event network-changed:16f31c6b-b8cc-44ef-b38c-0325cd60edfc for instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe on hv-cinder-maste Apr 01 10:08:02.365552 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-186098d8-220f-4246-96bb-413ea4f08b2c req-135c085f-f571-4880-ab12-4706169a77a6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039625 Apr 01 10:08:02.366100 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 192/380] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:08:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:08:02.972086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:02.972917 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:02.979253 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:02.979723 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:02.980512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:02.981023 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:03.111766 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:03.119354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c500a46c-a1af-45c6-af2d-6ea4bd1c9f12 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.151340 Apr 01 10:08:03.119848 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 189/381] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:02 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:03.195045 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:03.195753 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:03.203033 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:03.203629 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:03.204803 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:03.205366 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:03.434741 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:03.443331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:03.445068 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:03.446240 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9b4a80d7-a0ab-4b21-bdda-b11b4ff8f32e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.255692 Apr 01 10:08:03.446850 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 193/382] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:03 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:03.842089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bbb92fca-9009-4d94-a23d-d988069edfcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f40b8d6-2844-4bc4-a359-8988c52fb930"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:03.843249 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bbb92fca-9009-4d94-a23d-d988069edfcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:03.849366 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bbb92fca-9009-4d94-a23d-d988069edfcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:03.849812 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bbb92fca-9009-4d94-a23d-d988069edfcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:03.850563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bbb92fca-9009-4d94-a23d-d988069edfcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:03.851024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bbb92fca-9009-4d94-a23d-d988069edfcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:04.108125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bbb92fca-9009-4d94-a23d-d988069edfcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269710 Apr 01 10:08:04.109163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 190/383] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:08:03 2022] POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:08:04.141907 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:04.142843 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:04.150706 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:04.151393 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:04.152205 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:04.152645 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:04.290925 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:04.298805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-60b40790-a39e-47f2-94a2-ae5b00630d23 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.161874 Apr 01 10:08:04.299488 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 194/384] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:04 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:04.465733 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:04.467030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:04.474860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:04.475311 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:04.476084 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:04.476486 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:04.616139 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:04.624791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:04.626292 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:04.627637 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0b9e7404-a8bf-4a64-ad55-4cc6f5cf4354 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.166864 Apr 01 10:08:04.628184 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 191/385] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:04 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:05.321827 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:05.322871 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:05.333297 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:05.334042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:05.335464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:05.336181 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:05.481640 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:05.489422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-85243849-721d-4217-85d4-6167c0708b3b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.175179 Apr 01 10:08:05.490000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 195/386] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:05 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:05.645816 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:05.646424 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:05.652972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:05.653414 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:05.654189 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:05.654621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:05.805777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:05.818284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:05.820839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:05.822713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bd17e89a-cbb9-4744-8bee-42911f2dbef4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.181000 Apr 01 10:08:05.823601 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 192/387] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:05 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:06.508603 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:06.509271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:06.515992 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:06.516472 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:06.517237 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:06.517667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:06.654301 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:06.661844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f701c7bc-363a-4470-82fc-dd77e5d036f3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.157557 Apr 01 10:08:06.662533 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 196/388] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:06 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:06.841725 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:06.842335 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:06.853515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:06.854040 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:06.854856 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:06.855383 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:07.011622 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:07.020318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:07.021793 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:07.022978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4edb8b4b-c34b-4707-a9e0-c821821a7826 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.185234 Apr 01 10:08:07.023525 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 193/389] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:06 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:07.682722 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:07.683843 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:07.691644 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:07.692237 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:07.693192 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:07.693734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:07.838543 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:07.849066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0366c4f1-871f-4266-95c4-a782fdb94a13 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.172710 Apr 01 10:08:07.849783 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 197/390] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:07 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:08.042083 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:08.042777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:08.049918 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:08.050371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:08.051181 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:08.051610 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:08.186264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:08.194011 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:08.195519 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:08.196683 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6f6261f2-328f-4cd9-ae2b-10f1f9b815b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.158853 Apr 01 10:08:08.197311 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 194/391] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:08 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:08.767110 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-de202442-808e-4b46-8a81-53a5d463d919 req-441370c9-b87a-4c75-ae8d-1ee2a71e7bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796459f-876f-4f0b-b0b1-aa45dbf9fabe", "name": "network-vif-plugged", "status": "completed", "tag": "16f31c6b-b8cc-44ef-b38c-0325cd60edfc"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:08.775571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-de202442-808e-4b46-8a81-53a5d463d919 req-441370c9-b87a-4c75-ae8d-1ee2a71e7bcb service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:08.776013 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-de202442-808e-4b46-8a81-53a5d463d919 req-441370c9-b87a-4c75-ae8d-1ee2a71e7bcb service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:08.788556 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-de202442-808e-4b46-8a81-53a5d463d919 req-441370c9-b87a-4c75-ae8d-1ee2a71e7bcb service nova] Creating event network-vif-plugged:16f31c6b-b8cc-44ef-b38c-0325cd60edfc for instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe on hv-cinder-maste Apr 01 10:08:08.793532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-de202442-808e-4b46-8a81-53a5d463d919 req-441370c9-b87a-4c75-ae8d-1ee2a71e7bcb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030276 Apr 01 10:08:08.794338 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 198/392] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:08:08.866963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:08.867695 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:08.873750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:08.874203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:08.875005 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:08.875439 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:09.065309 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:09.073298 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1bcbb0e1-872f-41e5-8661-d75f33b9c1a0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.210117 Apr 01 10:08:09.073894 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 195/393] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:08 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:09.219481 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:09.220165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:09.226840 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:09.227320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:09.228083 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:09.228514 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:09.372361 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:09.382198 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:09.384236 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:09.385823 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c34919bb-2195-43f3-91c3-86baeea1225a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.171785 Apr 01 10:08:09.386388 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 199/394] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:09 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:10.091071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:10.091749 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:10.098620 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:10.099104 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:10.099904 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:10.100329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:10.243604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:10.251404 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-30b285ee-5b20-444c-9502-cb7af7836da4 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1357 microversion: 2.1 time: 0.164398 Apr 01 10:08:10.251967 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 196/395] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:10 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:10.405517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:10.406176 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:10.413019 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:10.413472 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:10.414260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:10.415305 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:10.551881 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:10.559760 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:10.561256 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:10.562414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4dbe1135-6c09-4049-b0c5-c6fcca9f0c7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.161232 Apr 01 10:08:10.563004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 200/396] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:10 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:11.269079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:11.269706 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:11.276978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.277427 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.282535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.283031 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.427700 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:11.436265 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b4e3f82d-da0d-4572-b9ab-aea0e273ce68 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1548 microversion: 2.1 time: 0.171246 Apr 01 10:08:11.436945 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 197/397] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:11 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1548 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:11.453419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:11.453998 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:11.460123 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.460543 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.461316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.461740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.581298 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:11.581886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:11.588160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.588745 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.589524 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.590002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.596989 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:11.604777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4716b691-54d2-4bbb-a3fc-f1d115fc920f tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1548 microversion: 2.1 time: 0.155277 Apr 01 10:08:11.605347 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 201/398] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:11 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:11.620235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:11.623646 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:11.624438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Searching by: {'deleted': False, 'project_id': 'c4a61874308747efa6cf0456be5f46b6'} {{(pid=117066) get_all /opt/stack/nova/nova/compute/api.py:2960}} Apr 01 10:08:11.632148 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.632591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.633434 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.633863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.729926 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.multi_cell_list [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117066) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 01 10:08:11.732896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:11.740927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:11.742625 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:11.743981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-42ba4c28-fc6a-42a8-94bd-e94f0d42836a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.166621 Apr 01 10:08:11.744525 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 198/399] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:11 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:11.749037 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4a502587-9e52-4fb0-8402-1fb8278f4927 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:11.754843 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4a502587-9e52-4fb0-8402-1fb8278f4927 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.755300 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4a502587-9e52-4fb0-8402-1fb8278f4927 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.815034 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4a502587-9e52-4fb0-8402-1fb8278f4927 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Going to try to stop instance {{(pid=117065) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 01 10:08:11.828767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-20d4ead3-34f8-404a-b33e-12464254c77e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212023 Apr 01 10:08:11.829333 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 202/400] 10.222.0.46 () {58 vars in 1124 bytes} [Fri Apr 1 10:08:11 2022] GET /compute/v2.1/servers => generated 342 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:08:11.839444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:11.840260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:11.846213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.846690 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.847469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.847904 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.862093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4a502587-9e52-4fb0-8402-1fb8278f4927 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action" status: 202 len: 0 microversion: 2.1 time: 0.116183 Apr 01 10:08:11.862900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 199/401] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:08:11 2022] POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:08:11.875937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:11.876706 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:11.884057 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.884552 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.885334 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:11.885816 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:11.987287 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:11.994834 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-87c5ac2f-8333-4150-9135-20590e4e905e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1548 microversion: 2.1 time: 0.158913 Apr 01 10:08:11.995334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 203/402] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:11 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1548 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:08:12.028484 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:12.036489 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e12e53df-f73a-4820-b9f6-d74741633e34 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.165039 Apr 01 10:08:12.037056 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 200/403] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:11 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:08:12.764500 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:12.765538 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:12.774164 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:12.774804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:12.775809 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:12.776380 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:12.911242 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:12.924695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:12.927595 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:12.929754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-882cfb10-236d-4c64-996c-67382e63aeaa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.170174 Apr 01 10:08:12.930587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 204/404] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:12 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:13.055169 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:13.055712 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:13.062453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:13.062937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:13.063707 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:13.064148 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:13.421310 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:13.429308 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-562f0eac-83ad-4659-a087-d315a75583de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.378151 Apr 01 10:08:13.429964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 201/405] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:13 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:13.520468 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-34b22f93-ec32-4105-8325-4a2e20d7367c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "79903a34-6a75-479f-b375-95d40f9fe01d"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:13.521619 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-34b22f93-ec32-4105-8325-4a2e20d7367c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:13.527505 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34b22f93-ec32-4105-8325-4a2e20d7367c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:13.527939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34b22f93-ec32-4105-8325-4a2e20d7367c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:13.528694 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34b22f93-ec32-4105-8325-4a2e20d7367c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:13.529171 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34b22f93-ec32-4105-8325-4a2e20d7367c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:13.806920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-34b22f93-ec32-4105-8325-4a2e20d7367c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.290470 Apr 01 10:08:13.807872 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 205/406] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:08:13 2022] POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments => generated 194 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:08:13.950750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:13.951366 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:13.957997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:13.958452 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:13.959270 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:13.959723 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:14.101627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:14.110136 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:14.111561 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:14.112789 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5c0bb7a5-e985-4555-87ae-7c5ee5f23c91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.166110 Apr 01 10:08:14.113382 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 202/407] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:13 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:14.447979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:14.448682 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:14.455873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:14.456327 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:14.457102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:14.457534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:14.601009 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:14.609040 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-895d207a-7890-4e71-bc5e-f659cdadf3db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.165925 Apr 01 10:08:14.609611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 206/408] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:14 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:15.138626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:15.139711 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:15.148382 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:15.148824 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:15.149582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:15.150008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:15.300522 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:15.308658 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:15.310155 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:15.311367 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e8ade436-bf2d-440d-beaa-cbbad8fe88ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.179788 Apr 01 10:08:15.312157 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 203/409] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:15 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:15.627051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:15.627836 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:15.634441 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:15.634935 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:15.635701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:15.636134 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:15.776679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:15.785152 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-db9f8090-fe8e-446e-8e77-ccaf8fe48a16 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.161927 Apr 01 10:08:15.785718 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 207/410] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:15 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:16.334354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:16.335388 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:16.346152 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:16.346958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:16.348248 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:16.348681 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:16.499248 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:16.507211 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:16.508754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:16.509881 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4bc07e34-42d6-4583-ad80-67169ff359b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.182071 Apr 01 10:08:16.510441 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 204/411] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:16 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:08:16.802768 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:16.803334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:16.810093 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:16.810546 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:16.811345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:16.811779 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:16.953712 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:16.962370 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-53252d56-133b-4707-9885-234e6e33fb5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.163696 Apr 01 10:08:16.962982 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 208/412] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:16 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:17.533597 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:17.534178 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:17.543904 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:17.544370 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:17.545509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:17.546079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:17.687773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:17.696201 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:17.697732 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:17.698937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cc16394a-2b0d-4658-a7ea-3bfb5ddb1d2d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.171366 Apr 01 10:08:17.699493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 205/413] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:17 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:17.980693 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:17.981345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:17.989300 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:17.989828 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:17.990771 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:17.991272 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:18.132718 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:18.144727 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-57427d73-9d3c-4530-a052-81b7086a4d9f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.168186 Apr 01 10:08:18.145281 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 209/414] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:17 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:18.717697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:18.718284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:18.724872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:18.725325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:18.726088 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:18.726520 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:18.871310 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:18.879528 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:18.881048 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:18.882182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3b69914f-9b38-4138-9351-33fab6d24d6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.168686 Apr 01 10:08:18.882747 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 206/415] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:18 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:19.161412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:19.161969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:19.168732 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:19.169183 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:19.169952 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:19.170382 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:19.307689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:19.316101 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0d60d215-fe3b-415c-9739-5b62d6121707 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.158524 Apr 01 10:08:19.316750 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 210/416] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:19 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:19.901738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:19.902415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:19.910103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:19.910607 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:19.911405 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:19.911844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:20.050672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:20.058827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:20.060314 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:20.061462 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1cc48e32-0950-4ac9-a848-11e7b5a314c0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1745 microversion: 2.20 time: 0.163824 Apr 01 10:08:20.062021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 207/417] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:19 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:08:20.335254 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:20.335921 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:20.344214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:20.344776 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:20.345730 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:20.346266 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:20.486869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:20.495022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-96c9d473-9660-499f-b243-07e70acd294a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.164647 Apr 01 10:08:20.495597 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 211/418] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:20 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:21.080332 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:21.080890 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:21.087694 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:21.088154 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:21.089044 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:21.089567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:21.232575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:21.240786 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:21.242428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:21.243623 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-fddad2f4-cb1b-48c5-afac-f6aa001ea677 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1745 microversion: 2.20 time: 0.167445 Apr 01 10:08:21.244176 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 208/419] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:21 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:21.356267 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:21.356754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:21.363496 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:21.363937 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:21.364696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:21.365120 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:21.511474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:21.512257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:21.519061 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:21.519508 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:21.520278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:21.520713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:21.527413 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:21.535736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-80267bf2-cd6c-4aaf-aae4-2c4fc21ad372 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1594 microversion: 2.1 time: 0.183323 Apr 01 10:08:21.536275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 212/420] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:21 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1594 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:21.656604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:21.664766 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1ee92ca1-b9a5-4d52-8f65-1a2762191ec2 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.157086 Apr 01 10:08:21.665401 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 209/421] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:21 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:22.261653 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:22.262255 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:22.268679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:22.269133 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:22.269906 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:22.270334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:22.402610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:22.411111 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:22.412609 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:22.413774 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3ec4c4e1-ba52-4be7-a94c-e3b460d84b6f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1745 microversion: 2.20 time: 0.156243 Apr 01 10:08:22.414559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 213/422] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:22 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:22.681483 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:22.682062 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:22.688623 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:22.689071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:22.689827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:22.690239 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:22.843735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-67eee74d-f4f1-47d4-ba13-69cf73c19702 req-c7502182-d2e4-4d89-a2f7-e09f93997e75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c911a2-ef42-4d2a-bea9-a6c56575559f", "name": "network-vif-plugged", "status": "completed", "tag": "b8c404b8-1348-40f2-87ab-56e8fc6c155a"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:22.853157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-67eee74d-f4f1-47d4-ba13-69cf73c19702 req-c7502182-d2e4-4d89-a2f7-e09f93997e75 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:22.853819 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-67eee74d-f4f1-47d4-ba13-69cf73c19702 req-c7502182-d2e4-4d89-a2f7-e09f93997e75 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:22.867570 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-67eee74d-f4f1-47d4-ba13-69cf73c19702 req-c7502182-d2e4-4d89-a2f7-e09f93997e75 service nova] Creating event network-vif-plugged:b8c404b8-1348-40f2-87ab-56e8fc6c155a for instance f0c911a2-ef42-4d2a-bea9-a6c56575559f on hv-cinder-maste Apr 01 10:08:22.873279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-67eee74d-f4f1-47d4-ba13-69cf73c19702 req-c7502182-d2e4-4d89-a2f7-e09f93997e75 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034668 Apr 01 10:08:22.874124 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 214/423] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:08:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:08:22.931318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:22.939758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2f475a44-8e1b-40cf-b47c-be13dcad8e2e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.262150 Apr 01 10:08:22.941454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 210/424] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:22 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:23.430037 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-0d07108f-bc14-4538-9faa-d2e3ab709426 req-3c79c89b-9db5-4001-9abf-e555769e210e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796459f-876f-4f0b-b0b1-aa45dbf9fabe", "tag": "16f31c6b-b8cc-44ef-b38c-0325cd60edfc"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:23.431949 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:23.432563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:23.440469 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:23.440921 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:23.442085 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:23.442532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:23.444466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-0d07108f-bc14-4538-9faa-d2e3ab709426 req-3c79c89b-9db5-4001-9abf-e555769e210e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:23.444971 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-0d07108f-bc14-4538-9faa-d2e3ab709426 req-3c79c89b-9db5-4001-9abf-e555769e210e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:23.460787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-0d07108f-bc14-4538-9faa-d2e3ab709426 req-3c79c89b-9db5-4001-9abf-e555769e210e service nova] Creating event network-changed:16f31c6b-b8cc-44ef-b38c-0325cd60edfc for instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe on hv-cinder-maste Apr 01 10:08:23.474739 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-0d07108f-bc14-4538-9faa-d2e3ab709426 req-3c79c89b-9db5-4001-9abf-e555769e210e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049295 Apr 01 10:08:23.476056 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 215/425] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:08:23.681836 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:23.689864 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:23.691706 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:23.693052 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e8f4eadc-f67c-433c-8950-38c73e14eeb5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1745 microversion: 2.20 time: 0.265031 Apr 01 10:08:23.704130 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 211/426] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:23 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1745 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:08:23.958053 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:23.959160 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:23.965908 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:23.968440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:23.973268 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:23.974877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:24.202964 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:24.213828 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a40f3f12-b42e-4c12-abae-63607a1e1735 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.260284 Apr 01 10:08:24.224689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 216/427] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:23 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:24.511774 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-638763313"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:24.512308 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:24.518931 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:24.519419 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:24.520655 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:24.520655 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:24.651371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.network.security_group_api [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Adding security group 20177396-2571-4f5b-bfa6-d0d00e6adc2f to port 16f31c6b-b8cc-44ef-b38c-0325cd60edfc Apr 01 10:08:24.711669 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:24.712262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:24.718195 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:24.718641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:24.719450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:24.720102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:24.849572 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:24.857562 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:24.859206 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:24.860459 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d87bd320-65a5-44a6-a552-54f4bb81a322 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1745 microversion: 2.20 time: 0.152750 Apr 01 10:08:24.861448 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 217/428] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:24 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:25.230297 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:25.230929 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:25.237225 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-54d0b9fe-00e6-4c38-99e7-ca3eaa1d8f27 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/action" status: 202 len: 0 microversion: 2.1 time: 0.729489 Apr 01 10:08:25.240285 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 212/429] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:08:24 2022] POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:08:25.243477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:25.243477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:25.244047 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:25.244465 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:25.252954 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:25.253589 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:25.262012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:25.262012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:25.262806 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:25.263241 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:25.441506 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:25.456635 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-fa974580-5977-4146-b3e1-596c5adb409a tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1759 microversion: 2.1 time: 0.208491 Apr 01 10:08:25.458167 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 213/430] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:25 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1759 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:25.493962 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-6f322629-7d74-4262-9e61-0d4489f430f3 req-ea60cff6-cce4-4e36-97ba-4adaa40c704a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796459f-876f-4f0b-b0b1-aa45dbf9fabe", "tag": "16f31c6b-b8cc-44ef-b38c-0325cd60edfc"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:25.503923 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-6f322629-7d74-4262-9e61-0d4489f430f3 req-ea60cff6-cce4-4e36-97ba-4adaa40c704a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:25.504380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-6f322629-7d74-4262-9e61-0d4489f430f3 req-ea60cff6-cce4-4e36-97ba-4adaa40c704a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:25.516943 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-6f322629-7d74-4262-9e61-0d4489f430f3 req-ea60cff6-cce4-4e36-97ba-4adaa40c704a service nova] Creating event network-changed:16f31c6b-b8cc-44ef-b38c-0325cd60edfc for instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe on hv-cinder-maste Apr 01 10:08:25.523034 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-6f322629-7d74-4262-9e61-0d4489f430f3 req-ea60cff6-cce4-4e36-97ba-4adaa40c704a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032913 Apr 01 10:08:25.523964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 214/431] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:08:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:08:25.676389 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:25.684943 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d2053538-f378-4940-9af6-0d31f32cebc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.458499 Apr 01 10:08:25.685514 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 218/432] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:25 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:08:25.880922 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:25.881613 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:25.888115 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:25.888562 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:25.889664 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:25.890101 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:26.118390 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:26.126727 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:26.128232 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:26.129666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-70d67c60-5533-465c-a99b-ddad88aa632d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1745 microversion: 2.20 time: 0.253583 Apr 01 10:08:26.130780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 215/433] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:25 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1745 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:26.706822 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:26.707466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:26.715165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:26.715697 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:26.716611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:26.717125 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:26.861069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:26.869316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-19e0d3e1-9825-4e6a-b303-6b41fdad700e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1724 microversion: 2.1 time: 0.169226 Apr 01 10:08:26.869876 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 219/434] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:26 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:27.152719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:27.153963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:27.164877 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:27.165616 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:27.167012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:27.167951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:27.305815 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:27.313931 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:27.315454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:27.316666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-66043797-1b9a-49e8-a2e8-e39caf06e4e9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1745 microversion: 2.20 time: 0.170520 Apr 01 10:08:27.317416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 216/435] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:27 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:27.886122 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:27.886844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:27.893434 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:27.893873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:27.894762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:27.895187 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:28.030046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:28.037971 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d0aec384-69f9-4864-889e-5a60e5373de9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1701 microversion: 2.1 time: 0.155647 Apr 01 10:08:28.038532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 220/436] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:27 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1701 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:28.054930 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-252d5f88-5feb-4c78-86ab-2f207e2d8ac9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:28.061133 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-252d5f88-5feb-4c78-86ab-2f207e2d8ac9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:28.061579 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-252d5f88-5feb-4c78-86ab-2f207e2d8ac9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:28.084974 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-252d5f88-5feb-4c78-86ab-2f207e2d8ac9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Going to try to start instance {{(pid=117065) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 01 10:08:28.131855 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-252d5f88-5feb-4c78-86ab-2f207e2d8ac9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action" status: 202 len: 0 microversion: 2.1 time: 0.081462 Apr 01 10:08:28.132621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 217/437] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:08:28 2022] POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:08:28.141021 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:28.141786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:28.148877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:28.149336 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:28.150153 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:28.150534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:28.306433 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:28.315520 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-80da976e-b0c1-42eb-bbab-437418cefe5b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1710 microversion: 2.1 time: 0.178553 Apr 01 10:08:28.316626 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 221/438] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:28 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1710 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:28.335134 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:28.335829 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:28.342441 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:28.342923 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:28.343701 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:28.344132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:28.577939 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:28.598719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:28.600745 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:28.602394 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2efead77-53d8-45c3-a19d-f8712513cf57 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.271430 Apr 01 10:08:28.603677 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 218/439] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:28 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:29.333906 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:29.334508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:29.341414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:29.341863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:29.342635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:29.343137 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:29.481685 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:29.490821 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d20d3768-e4ae-4740-b44e-0a91996c8bc0 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1710 microversion: 2.1 time: 0.160837 Apr 01 10:08:29.491891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 222/440] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:29 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1710 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:29.621633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:29.622870 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:29.638512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:29.639005 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:29.639813 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:29.640245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:29.781607 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:29.804004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:29.805526 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:29.806778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f7c6f82b-f248-424e-a755-add50e0cfe4a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.189112 Apr 01 10:08:29.817680 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 219/441] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:29 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:08:30.508778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:30.510116 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:30.517072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:30.517535 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:30.518686 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:30.519152 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:30.678382 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:30.688482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-af5e6715-b25c-4b65-8d3e-e900588faadc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1714 microversion: 2.1 time: 0.183708 Apr 01 10:08:30.689059 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 223/442] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:08:30 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1714 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:08:30.828891 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:30.830157 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:30.839393 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:30.839843 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:30.841362 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:30.842083 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:30.982777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:30.991749 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:30.993322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:30.994490 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f7c112c8-56db-4e7b-91d4-f6197470f8f5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.172409 Apr 01 10:08:30.995128 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 220/443] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:30 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:32.012886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:32.013602 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:32.020497 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:32.020944 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:32.021693 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:32.022129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:32.159362 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:32.167153 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:32.168647 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:32.169802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-89db1ecc-4200-42cc-b310-3a19b250e7c4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.160900 Apr 01 10:08:32.170363 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 224/444] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:32 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:33.194053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:33.194800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:33.205466 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:33.206525 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:33.208214 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:33.208960 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:33.359589 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:33.368023 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:33.369498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:33.370661 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d40703e1-13b4-4f47-8459-960b0e81364a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.186184 Apr 01 10:08:33.371224 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 221/445] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:33 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:34.389570 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:34.390208 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:34.397687 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:34.398215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:34.398967 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:34.399417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:34.544030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:34.552353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:34.554003 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:34.555420 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-34f6fec6-212f-43d4-93cc-cecd9090aac3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.169836 Apr 01 10:08:34.556062 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 225/446] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:34 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:35.574398 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:35.575051 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:35.583223 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:35.583689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:35.584469 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:35.584905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:35.725011 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:35.733572 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:35.735106 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:35.736503 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-37fd5d59-ebeb-4e50-a0bd-a722d708c252 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.166417 Apr 01 10:08:35.737587 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 222/447] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:35 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:36.755018 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:36.756458 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:36.762921 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:36.766195 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:36.767027 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:36.767451 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:36.906687 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:36.914927 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:36.916549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:36.917764 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c9a79eff-f8d7-42f4-8040-fbc1e389cb9a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.166779 Apr 01 10:08:36.918562 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 226/448] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:36 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:37.936974 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:37.938358 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:37.945665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:37.946350 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:37.947340 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:37.947754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:38.103599 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:38.112473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:38.114043 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:38.115459 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2a78cbca-92ec-482f-b508-f297541bdefe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.182505 Apr 01 10:08:38.116183 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 223/449] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:37 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:39.135886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:39.137195 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:39.144723 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:39.146061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:39.146886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:39.147320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:39.287220 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:39.302770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:39.304568 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:39.306208 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5e3a41d0-b1f6-42d4-87da-aef5c081089c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.174972 Apr 01 10:08:39.306793 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 227/450] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:39 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:40.324768 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:40.325409 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:40.332888 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:40.333620 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:40.334397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:40.335014 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:40.513847 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:40.522946 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:40.524757 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:40.526155 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6418d91a-a690-4061-bd2d-88d2bd11188c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.205451 Apr 01 10:08:40.539900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 224/451] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:40 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:41.549521 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:41.550713 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:41.561333 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:41.562081 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:41.563410 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:41.564135 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:41.696849 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:41.704693 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:41.706192 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:41.707411 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6349506b-5cfd-45dc-82ff-503cb4aa5477 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1740 microversion: 2.20 time: 0.164707 Apr 01 10:08:41.707972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 228/452] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:41 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1740 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:42.726486 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:42.727211 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:42.735059 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:42.735673 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:42.736825 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:42.737378 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:42.886448 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:42.899851 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:42.902212 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:42.903901 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-31c74ffb-222d-4563-94c3-f02c8d465cf7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1722 microversion: 2.20 time: 0.182035 Apr 01 10:08:42.904734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 225/453] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:42 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:43.929407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:43.930475 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:43.940800 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:43.941589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:43.942729 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:43.943165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:44.079396 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:44.087406 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:44.088913 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:44.090094 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9f97990d-c868-4244-ae00-5e430ea28388 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1722 microversion: 2.20 time: 0.167490 Apr 01 10:08:44.090674 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 229/454] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:43 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:44.911037 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-c8d9185a-9877-400b-bdaf-ee09ca6d9a3e req-1352c3f4-403c-45da-a532-5c67d0e9a97d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c911a2-ef42-4d2a-bea9-a6c56575559f", "name": "network-vif-unplugged", "status": "completed", "tag": "b8c404b8-1348-40f2-87ab-56e8fc6c155a"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:44.920426 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-c8d9185a-9877-400b-bdaf-ee09ca6d9a3e req-1352c3f4-403c-45da-a532-5c67d0e9a97d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:44.920868 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-c8d9185a-9877-400b-bdaf-ee09ca6d9a3e req-1352c3f4-403c-45da-a532-5c67d0e9a97d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:44.932090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.compute.server_external_events [req-c8d9185a-9877-400b-bdaf-ee09ca6d9a3e req-1352c3f4-403c-45da-a532-5c67d0e9a97d service nova] Unable to find a host for instance f0c911a2-ef42-4d2a-bea9-a6c56575559f. Dropping event network-vif-unplugged {{(pid=117065) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Apr 01 10:08:44.932951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-c8d9185a-9877-400b-bdaf-ee09ca6d9a3e req-1352c3f4-403c-45da-a532-5c67d0e9a97d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026047 Apr 01 10:08:44.933533 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 226/455] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:08:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Apr 01 10:08:45.111801 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:45.112651 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:45.122339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.123134 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.124416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.125251 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.265899 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:45.278992 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:45.281328 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:45.282883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2bcd8fac-2930-4e4e-9513-c11d822f1b02 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1665 microversion: 2.20 time: 0.177162 Apr 01 10:08:45.283427 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 230/456] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:45 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1665 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:45.301601 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bd34f730-00c0-47cd-b4b4-2f3baea17a76 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87eb331a-59bc-4f13-b6ab-aa861b239089"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:45.302691 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bd34f730-00c0-47cd-b4b4-2f3baea17a76 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:45.309200 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd34f730-00c0-47cd-b4b4-2f3baea17a76 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.309648 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd34f730-00c0-47cd-b4b4-2f3baea17a76 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.310415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd34f730-00c0-47cd-b4b4-2f3baea17a76 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.310907 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd34f730-00c0-47cd-b4b4-2f3baea17a76 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.596077 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bd34f730-00c0-47cd-b4b4-2f3baea17a76 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.298588 Apr 01 10:08:45.596683 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 227/457] 10.222.0.46 () {62 vars in 1363 bytes} [Fri Apr 1 10:08:45 2022] POST /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments => generated 188 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:08:45.717667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e790c9c2-277a-476e-b970-3d4e68c313bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:45.718232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e790c9c2-277a-476e-b970-3d4e68c313bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:45.724594 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e790c9c2-277a-476e-b970-3d4e68c313bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.725049 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e790c9c2-277a-476e-b970-3d4e68c313bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.725865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e790c9c2-277a-476e-b970-3d4e68c313bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.726291 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e790c9c2-277a-476e-b970-3d4e68c313bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.822270 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e790c9c2-277a-476e-b970-3d4e68c313bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/action" status: 202 len: 0 microversion: 2.20 time: 0.108527 Apr 01 10:08:45.822924 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 231/458] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 1 10:08:45 2022] POST /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:08:45.831093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:45.831709 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:45.838354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.838829 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.839599 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:45.840030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:45.971137 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:45.979705 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:45.981185 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:45.982367 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-834d70f3-20c3-465c-827c-17769d72a399 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1751 microversion: 2.20 time: 0.155203 Apr 01 10:08:45.982959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 228/459] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:45 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1751 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:47.001273 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:47.001892 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:47.009192 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:47.009648 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:47.010422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:47.010998 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:47.145535 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:47.154080 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:47.155603 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:47.156779 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1053db04-a0f9-475e-8c11-f1960f46e6d4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1753 microversion: 2.20 time: 0.159593 Apr 01 10:08:47.157329 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 232/460] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:46 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1753 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:48.175687 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:48.176304 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:48.182939 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:48.183370 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:48.184191 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:48.184634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:48.415381 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:48.424152 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:48.425653 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:48.426861 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ca85a455-c339-4530-9702-08004a1b905c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.255141 Apr 01 10:08:48.427664 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 229/461] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:48 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:49.445793 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:49.446416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:49.456241 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:49.456703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:49.457509 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:49.457946 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:49.614007 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:49.622255 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:49.623763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:49.624908 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c9669014-83b4-4765-9d2d-f9b7fe7a7c9d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.183388 Apr 01 10:08:49.625470 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 233/462] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:49 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:50.648358 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:50.649055 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:50.656039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:50.656602 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:50.657467 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:50.657905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:50.808526 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:50.817391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:50.818985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:50.820248 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f0dc43a9-a3cb-4197-bc78-5c98523a1ed4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.178993 Apr 01 10:08:50.820832 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 230/463] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:50 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:51.839603 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:51.840154 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:51.847354 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:51.847792 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:51.848635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:51.849072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:51.998427 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:52.007136 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:52.008677 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:52.009867 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3051bf3c-b650-4bcf-b42d-1221a8ddb4b9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.174351 Apr 01 10:08:52.010419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 234/464] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:51 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:53.032084 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:53.032670 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:53.039546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:53.039991 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:53.040790 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:53.041222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:53.188649 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:53.197950 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:53.199596 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:53.200846 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4e092f9f-e0bf-4de2-888e-6af4b4365562 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.174293 Apr 01 10:08:53.201653 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 231/465] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:53 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:54.239566 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:54.240473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:54.255762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:54.256074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:54.256730 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:54.257187 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:54.427619 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:54.435795 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:54.437278 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:54.438424 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-08137a46-205a-407a-a42f-ee3492f5c46c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.203896 Apr 01 10:08:54.439003 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 235/466] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:54 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:55.457438 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:55.458089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:55.464914 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:55.465371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:55.466128 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:55.466586 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:55.604922 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:55.613716 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:55.615289 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:55.616538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-266da99b-4c06-49f0-b777-8b5aa65e4360 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.163131 Apr 01 10:08:55.627340 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 232/467] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:55 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:56.635280 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:56.635942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:56.643227 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:56.643695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:56.644444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:56.644868 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:56.787984 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:56.796747 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:56.798236 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:56.799423 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c2bdc004-5d72-4169-9eb6-ae9f64cb1823 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.168140 Apr 01 10:08:56.799974 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 236/468] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:56 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:08:56.934862 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-11ba0c29-5705-46e7-ae45-76a83915323b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17665e95-c58c-47fe-bd81-b224ff27ac9a"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:08:56.935999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-11ba0c29-5705-46e7-ae45-76a83915323b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:56.952827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-11ba0c29-5705-46e7-ae45-76a83915323b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:56.953297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-11ba0c29-5705-46e7-ae45-76a83915323b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:56.954078 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-11ba0c29-5705-46e7-ae45-76a83915323b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:56.954504 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-11ba0c29-5705-46e7-ae45-76a83915323b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:57.818707 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:57.819292 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:57.825758 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:57.826221 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:57.827013 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:57.827441 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:57.967065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:57.976522 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:57.978327 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:57.979956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-785174bb-da4a-416b-88bd-6586b870f9e3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.165367 Apr 01 10:08:57.991481 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 237/469] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:57 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:08:58.998846 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:08:58.999767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:08:59.007525 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:59.008019 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:59.008772 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:08:59.009244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:08:59.165162 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:59.175445 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:59.176931 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:08:59.178165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-13744e6d-ea82-4ad7-95f0-673b6e50373e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.183961 Apr 01 10:08:59.178925 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 238/470] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:08:58 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:00.197582 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:00.198252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:00.205079 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:00.205541 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:00.206312 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:00.206780 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:00.345249 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:00.353995 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:00.355515 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:00.356658 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-eeb48f7b-3bd8-47ba-9ffc-ca9ea00b3741 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.163063 Apr 01 10:09:00.357213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 239/471] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:00 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:01.378903 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:01.379895 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:01.390579 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:01.391381 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:01.393019 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:01.393735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:01.539451 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:01.547943 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:01.549409 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:01.550563 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fc9867f2-7333-4268-8b48-0abc77e7eb91 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.178619 Apr 01 10:09:01.551138 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 240/472] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:01 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:02.573340 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:02.574310 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:02.584787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:02.585540 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:02.586873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:02.587593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:02.783518 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:02.792273 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:02.793767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:02.794988 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-361da40f-7299-4114-aefe-8c06ef22b16a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.228223 Apr 01 10:09:02.795553 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 241/473] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:02 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:03.166665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-11ba0c29-5705-46e7-ae45-76a83915323b tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.235878 Apr 01 10:09:03.167389 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 233/474] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:08:56 2022] POST /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments => generated 194 bytes in 6238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:09:03.814542 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:03.815253 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:03.823004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:03.823507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:03.824538 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:03.824967 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:03.965683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:03.974454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:03.975980 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:03.977142 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-36da384c-0b16-4514-9dfe-be34262eefb3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.167306 Apr 01 10:09:03.977717 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 242/475] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:03 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:05.001747 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:05.002955 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:05.014947 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:05.015665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:05.017329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:05.018063 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:05.164345 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:05.172872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:05.174381 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:05.175600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4ee97985-0aa2-491c-b342-fc6543dd7def tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.181963 Apr 01 10:09:05.176208 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 234/476] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:04 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:05.913623 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:09:05.913999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:09:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:09:06.199122 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:06.199802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:06.207960 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:06.208519 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:06.209475 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:06.210018 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:06.355424 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:06.363809 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:06.365288 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:06.366464 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-22642e2b-7ad6-47b8-8300-fa370124724a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.174174 Apr 01 10:09:06.367057 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 243/477] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:06 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:07.385406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:07.386140 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:07.393471 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:07.393923 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:07.394994 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:07.395446 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:07.545249 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:07.553877 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:07.555425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:07.556610 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1338ab37-42da-4b2a-bcda-552cdc9459f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.175189 Apr 01 10:09:07.557180 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 235/478] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:07 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:08.579286 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:08.580301 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:08.590611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:08.591096 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:08.591938 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:08.592373 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:08.723598 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:08.731884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:08.733414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:08.734581 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c285b6ed-61ad-4b6e-9523-1feb56fe379f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.161851 Apr 01 10:09:08.735182 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 244/479] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:08 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:09.756920 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:09.757965 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:09.766165 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:09.766618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:09.767761 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:09.768192 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:09.923023 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:09.931517 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:09.932995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:09.934197 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b7a841f8-5ae2-40af-9b0b-699a7e68204a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.183768 Apr 01 10:09:09.934786 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 236/480] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:09 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:10.696365 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:10.697430 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:10.704281 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:10.704724 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:10.705480 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:10.705965 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:10.727217 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.objects.instance [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lazy-loading 'flavor' on Instance uuid 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a {{(pid=117066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:09:10.865360 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-21b58af5-6419-40cf-8b64-c6db4bdaa513 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/action" status: 200 len: 32 microversion: 2.1 time: 0.172871 Apr 01 10:09:10.866032 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 245/481] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:09:10 2022] POST /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:09:10.875640 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:10.876249 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:10.883234 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:10.883699 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:10.884564 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:10.885006 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:10.954977 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:10.955858 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:10.962622 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:10.963117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:10.964094 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:10.964540 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:11.104748 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:11.114353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ffc781e7-1d8a-4f87-a8a3-655f31223077 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.242501 Apr 01 10:09:11.115369 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 237/482] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:10 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:11.124035 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:11.128237 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:11.129846 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:11.131215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-edb6b067-d796-4a9a-9e80-7ef9f264337b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.181892 Apr 01 10:09:11.142587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 246/483] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:10 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:12.136946 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:12.137684 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:12.147778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:12.148324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:12.149365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:12.149869 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:12.151244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:12.151972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:12.160277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:12.160842 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:12.161804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:12.165844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:12.288259 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:12.296190 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4c2b2e2b-b0d8-462c-b3b2-e5d677de4fda tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.165953 Apr 01 10:09:12.296759 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 238/484] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:12 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:12.301857 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:12.310302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:12.311778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:12.312929 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-397ac232-8c70-4831-9ce9-0bab1661918b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.166769 Apr 01 10:09:12.313505 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 247/485] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:12 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:13.096077 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-c28d7a9c-ed0d-4e88-a7a4-b0ace9dae792 req-bad86962-245c-4157-a69d-761d0ebaa7b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c911a2-ef42-4d2a-bea9-a6c56575559f", "name": "network-vif-plugged", "status": "completed", "tag": "b8c404b8-1348-40f2-87ab-56e8fc6c155a"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:13.105943 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-c28d7a9c-ed0d-4e88-a7a4-b0ace9dae792 req-bad86962-245c-4157-a69d-761d0ebaa7b3 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:13.106456 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-c28d7a9c-ed0d-4e88-a7a4-b0ace9dae792 req-bad86962-245c-4157-a69d-761d0ebaa7b3 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:13.118092 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-c28d7a9c-ed0d-4e88-a7a4-b0ace9dae792 req-bad86962-245c-4157-a69d-761d0ebaa7b3 service nova] Creating event network-vif-plugged:b8c404b8-1348-40f2-87ab-56e8fc6c155a for instance f0c911a2-ef42-4d2a-bea9-a6c56575559f on hv-cinder-maste Apr 01 10:09:13.123385 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-c28d7a9c-ed0d-4e88-a7a4-b0ace9dae792 req-bad86962-245c-4157-a69d-761d0ebaa7b3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031074 Apr 01 10:09:13.123989 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 239/486] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:09:13.314189 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:13.314949 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:13.321661 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:13.322234 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:13.323188 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:13.323746 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:13.334536 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:13.335254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:13.343406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:13.343817 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:13.344778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:13.345191 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:13.458630 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:13.466429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-61d75ce2-9553-4fe1-838a-0af53da0b7c2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.156167 Apr 01 10:09:13.467258 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 248/487] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:13 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:13.483085 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:13.491448 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:13.492935 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:13.494094 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d69c690d-57d2-4d41-93aa-34f28a3d92f8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.166166 Apr 01 10:09:13.494698 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 240/488] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:13 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:14.485370 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:14.485937 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:14.494479 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:14.494965 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:14.495774 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:14.496210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:14.511963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:14.512652 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:14.519808 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:14.520387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:14.521184 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:14.521626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:14.633966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:14.642639 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-03ddee3d-cfa3-4472-9e4d-0e25115c6246 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.161171 Apr 01 10:09:14.643233 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 249/489] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:14 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:14.877499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:14.889814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:14.891340 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:14.892823 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8e56a904-3581-4885-8a35-78bf4caeca88 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.384807 Apr 01 10:09:14.893404 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 241/490] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:14 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:15.659717 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:15.660452 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:15.669029 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:15.669737 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:15.670751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:15.671432 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:15.810003 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:15.818423 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fbc9f648-5e7c-420e-b357-3cccf3b41328 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.162456 Apr 01 10:09:15.819039 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 250/491] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:15 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:15.911678 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:15.912245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:15.919157 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:15.919618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:15.920448 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:15.920902 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:16.061620 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:16.070458 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:16.071995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:16.073154 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8d27ea56-688a-4e9b-ba45-84c8e4e2a1fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1809 microversion: 2.20 time: 0.165772 Apr 01 10:09:16.073695 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 242/492] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:15 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:16.960838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:16.961561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:16.969273 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:16.969757 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:16.970519 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:16.970976 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:17.091868 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:17.092474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:17.100353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:17.100731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:17.101502 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:17.101932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:17.116961 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:17.125254 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4f18df73-c436-4411-be5f-196b278d8cb8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.290817 Apr 01 10:09:17.125830 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 251/493] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:16 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:17.238358 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:17.248909 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:17.251226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:17.253088 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-31cada12-26fb-46aa-b5f9-284ee538f65b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1796 microversion: 2.20 time: 0.165082 Apr 01 10:09:17.253713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 243/494] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:09:17 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1796 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:09:18.143345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:18.143970 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:18.150772 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:18.151225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:18.152001 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:18.152439 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:18.284734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:18.293155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0bba3f77-3332-401a-82ee-0775aa163727 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.154242 Apr 01 10:09:18.293706 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 252/495] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:18 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:19.318962 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:19.319953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:19.329337 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:19.329786 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:19.330563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:19.331023 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:19.480626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:19.490266 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-468ef5a6-019e-4793-a166-a20184309f12 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.177725 Apr 01 10:09:19.493734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 244/496] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:19 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:20.511337 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:20.511957 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:20.521376 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:20.521974 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:20.523123 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:20.523702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:20.665671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:20.676493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-56f932cd-d8bd-47bd-9b88-37b9ee787c23 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.171621 Apr 01 10:09:20.677063 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 253/497] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:20 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:21.697458 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:21.698488 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:21.706877 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:21.707325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:21.708086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:21.708512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:21.845534 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:21.854018 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-29d2d1d4-4ce3-498a-9380-0198fa70eb56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.163043 Apr 01 10:09:21.854567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 245/498] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:21 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:22.876756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:22.877522 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:22.886835 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:22.887401 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:22.888517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:22.889062 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:23.035150 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:23.047648 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fb9e7d02-c852-45de-86ed-cd04f75548dd tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.177275 Apr 01 10:09:23.048227 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 254/499] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:22 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:24.075215 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:24.076185 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:24.086495 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:24.087055 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:24.087755 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:24.088189 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:24.235130 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:24.243666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-99e38bae-b643-4693-94f5-eaa3d4533baa tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.175085 Apr 01 10:09:24.244294 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 246/500] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:24 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:25.266612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:25.267786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:25.274763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:25.275219 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:25.275997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:25.276412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:25.420145 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:25.428540 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-685bbb80-b9fd-468c-903c-3c8f34543d88 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.169522 Apr 01 10:09:25.429126 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 255/501] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:25 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:26.449554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:26.450501 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:26.461297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:26.462034 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:26.463327 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:26.464039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:26.607884 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:26.616264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-105cc754-d910-497e-8be3-ee70f32d3880 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.173154 Apr 01 10:09:26.616844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 247/502] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:26 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:27.637713 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:27.638735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:27.647338 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:27.647796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:27.648568 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:27.649006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:27.798441 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:27.807020 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-eee21da3-d43c-4f22-a337-b2a775c89260 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.175961 Apr 01 10:09:27.807614 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 256/503] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:27 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:28.824487 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:28.825033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:28.831757 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:28.832211 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:28.832976 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:28.833406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:29.026992 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:29.034955 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-55d89789-3dd3-40d2-a545-c8aeaf6abb2f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.214454 Apr 01 10:09:29.035535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 248/504] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:28 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:30.054132 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:30.055090 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:30.063996 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:30.064700 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:30.065544 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:30.065979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:30.202066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:30.210698 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-18e0a013-c52a-4308-a62b-0f8769ed9494 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1736 microversion: 2.1 time: 0.161921 Apr 01 10:09:30.211305 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 257/505] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:30 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:31.232128 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:31.233103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:31.241321 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.241777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.242545 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.243019 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.385301 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:31.394153 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3662be94-1309-471c-b3f0-319c9138f3a0 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1716 microversion: 2.1 time: 0.168529 Apr 01 10:09:31.394783 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 249/506] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:31 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1716 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:31.455652 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:31.456169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:31.462846 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.463296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.464060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.464499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.592272 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] HTTP exception thrown: Cannot 'detach_volume' instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a while it is in vm_state rescued Apr 01 10:09:31.592880 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Returning 409 to user: Cannot 'detach_volume' instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a while it is in vm_state rescued {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:09:31.593748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ad80dfbf-2719-424a-83e6-39cde2be7f59 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments/17665e95-c58c-47fe-bd81-b224ff27ac9a" status: 409 len: 152 microversion: 2.1 time: 0.144770 Apr 01 10:09:31.594292 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 258/507] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:09:31 2022] DELETE /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments/17665e95-c58c-47fe-bd81-b224ff27ac9a => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 01 10:09:31.603027 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a227906c-f2d9-4a93-bec9-7b8c6799eed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:31.603582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a227906c-f2d9-4a93-bec9-7b8c6799eed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:31.609979 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a227906c-f2d9-4a93-bec9-7b8c6799eed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.610415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a227906c-f2d9-4a93-bec9-7b8c6799eed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.611222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a227906c-f2d9-4a93-bec9-7b8c6799eed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.611661 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a227906c-f2d9-4a93-bec9-7b8c6799eed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.679730 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a227906c-f2d9-4a93-bec9-7b8c6799eed7 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "POST /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/action" status: 202 len: 0 microversion: 2.1 time: 0.080500 Apr 01 10:09:31.680345 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 250/508] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:09:31 2022] POST /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:09:31.692893 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:31.693537 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:31.700001 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.700477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.701275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:31.701783 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:31.836702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:31.844851 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6e12ceac-a2eb-4f8c-9a91-185864a82868 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1724 microversion: 2.1 time: 0.159044 Apr 01 10:09:31.845424 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 259/509] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:31 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:32.868168 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:32.875755 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:32.880172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:32.880931 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:32.882212 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:32.882995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:33.040525 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:33.048903 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-19dac595-4087-4c32-a399-f67b338022c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1724 microversion: 2.1 time: 0.189370 Apr 01 10:09:33.049543 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 251/510] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:32 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1724 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:34.070480 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:34.071481 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:34.082204 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:34.083022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:34.084306 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:34.085030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:34.227060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:34.235054 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b946f335-5eed-4f0f-afb7-386a9df932b8 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1724 microversion: 2.1 time: 0.171384 Apr 01 10:09:34.235624 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 260/511] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:34 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:35.256871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:35.257868 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:35.269301 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:35.269735 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:35.270508 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:35.270986 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:35.416310 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:35.424718 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-afa9443a-2fdf-4acd-93e4-09363ddc4138 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1730 microversion: 2.1 time: 0.174735 Apr 01 10:09:35.425355 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 252/512] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:35 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:35.443065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e4bd25e5-f263-4b9a-99b0-f3cd4ef4efe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:35.443604 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e4bd25e5-f263-4b9a-99b0-f3cd4ef4efe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:35.450356 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e4bd25e5-f263-4b9a-99b0-f3cd4ef4efe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:35.450919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e4bd25e5-f263-4b9a-99b0-f3cd4ef4efe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:35.451729 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e4bd25e5-f263-4b9a-99b0-f3cd4ef4efe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:35.452155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e4bd25e5-f263-4b9a-99b0-f3cd4ef4efe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:35.547778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e4bd25e5-f263-4b9a-99b0-f3cd4ef4efe3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110086 Apr 01 10:09:35.548381 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 261/513] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:09:35 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:09:36.547977 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-56541e64-23d2-454e-a1d7-5aaec77bf238 req-8f50fc42-76c3-47d6-9356-5833efb15d79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff54d32-e02c-4bb8-a3a6-3aec1474f63a", "tag": "78e92c0d-8920-4d6d-86a9-c78c75d01421"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:36.555994 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-56541e64-23d2-454e-a1d7-5aaec77bf238 req-8f50fc42-76c3-47d6-9356-5833efb15d79 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:36.556433 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-56541e64-23d2-454e-a1d7-5aaec77bf238 req-8f50fc42-76c3-47d6-9356-5833efb15d79 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:36.566928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-56541e64-23d2-454e-a1d7-5aaec77bf238 req-8f50fc42-76c3-47d6-9356-5833efb15d79 service nova] Creating event network-changed:78e92c0d-8920-4d6d-86a9-c78c75d01421 for instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a on hv-cinder-maste Apr 01 10:09:36.572187 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-56541e64-23d2-454e-a1d7-5aaec77bf238 req-8f50fc42-76c3-47d6-9356-5833efb15d79 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094697 Apr 01 10:09:36.573133 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 253/514] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:09:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:09:38.588487 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-2a53ca80-a97e-4593-8e3d-cd00eaaef80a req-3b223ef8-172f-4aad-9222-427c05fe6ba8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6ff54d32-e02c-4bb8-a3a6-3aec1474f63a", "tag": "78e92c0d-8920-4d6d-86a9-c78c75d01421"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:38.601474 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-2a53ca80-a97e-4593-8e3d-cd00eaaef80a req-3b223ef8-172f-4aad-9222-427c05fe6ba8 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:38.601920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-2a53ca80-a97e-4593-8e3d-cd00eaaef80a req-3b223ef8-172f-4aad-9222-427c05fe6ba8 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:38.613265 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-2a53ca80-a97e-4593-8e3d-cd00eaaef80a req-3b223ef8-172f-4aad-9222-427c05fe6ba8 service nova] Creating event network-changed:78e92c0d-8920-4d6d-86a9-c78c75d01421 for instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a on hv-cinder-maste Apr 01 10:09:38.618406 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-2a53ca80-a97e-4593-8e3d-cd00eaaef80a req-3b223ef8-172f-4aad-9222-427c05fe6ba8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035043 Apr 01 10:09:38.619040 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 262/515] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:09:39.468564 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:39.469145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:39.476174 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:39.476630 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:39.477411 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:39.477848 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:39.602743 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lazy-loading 'services' on Instance uuid 7fecc8e1-f340-4be9-8243-7369fcf1dbca {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:09:39.721838 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0aab949e-b4e3-4ccb-b981-3281a6f7032c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-volume_attachments/4f40b8d6-2844-4bc4-a359-8988c52fb930" status: 202 len: 0 microversion: 2.1 time: 0.376543 Apr 01 10:09:39.722492 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 254/516] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:09:39 2022] DELETE /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-volume_attachments/4f40b8d6-2844-4bc4-a359-8988c52fb930 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:09:40.838686 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f0c292ee-ad1f-4257-9e78-c707d61d4164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:40.845340 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0c292ee-ad1f-4257-9e78-c707d61d4164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:40.845780 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0c292ee-ad1f-4257-9e78-c707d61d4164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:40.903779 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f0c292ee-ad1f-4257-9e78-c707d61d4164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Going to try to stop instance {{(pid=117066) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Apr 01 10:09:40.948611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f0c292ee-ad1f-4257-9e78-c707d61d4164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action" status: 202 len: 0 microversion: 2.1 time: 0.114137 Apr 01 10:09:40.949215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 263/517] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:09:40 2022] POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:09:40.958628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:40.959523 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:40.966215 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:40.966855 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:40.967726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:40.968189 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:41.105064 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:41.113279 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a77cbbfa-95c0-4e12-a20f-9768f35ad10c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.159439 Apr 01 10:09:41.113880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 255/518] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:40 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:42.133588 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:42.134282 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:42.142609 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:42.143156 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:42.144063 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:42.144567 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:42.281307 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:42.288847 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5b94fc33-4850-4bb2-a55b-c78d5a6fe80a tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.160971 Apr 01 10:09:42.289411 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 264/519] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:42 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:43.310534 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:43.311547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:43.321963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:43.322739 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:43.324004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:43.324716 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:43.470072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:43.478530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f9fe3424-59fe-41f6-88c2-e3e1729ba742 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.174399 Apr 01 10:09:43.479152 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 256/520] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:43 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:44.498612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:44.499400 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:44.507194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:44.507889 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:44.508660 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:44.509083 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:44.647790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:44.655597 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-11b9d1e0-2560-48e0-b7f8-fa3018b024c9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.162039 Apr 01 10:09:44.656172 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 265/521] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:44 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:45.677036 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:45.678040 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:45.688306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:45.689063 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:45.690337 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:45.691112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:45.835702 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:45.843633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9ef41624-3bd9-4ab8-abe9-23176edc54db tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.173203 Apr 01 10:09:45.844224 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 257/522] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:45 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:46.865979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:46.867078 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:46.875170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:46.875650 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:46.876468 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:46.876922 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:47.019065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:47.026516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-68157c69-594f-4dce-bd21-b06dbd595422 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.166926 Apr 01 10:09:47.027133 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 266/523] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:46 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:48.048254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:48.049216 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:48.060055 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:48.060848 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:48.062074 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:48.062842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:48.204203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:48.214931 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b03df3c3-e22b-44b4-8d44-d135d3ed56ce tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.173062 Apr 01 10:09:48.215745 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 258/524] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:48 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:49.236346 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:49.237315 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:49.248148 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:49.248902 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:49.250166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:49.250956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:49.397374 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:49.404956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-62684570-41ac-4aca-a4f6-0574fad22d9b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.175431 Apr 01 10:09:49.405529 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 267/525] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:49 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:50.274943 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:09:50.276146 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:09:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:09:50.425797 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:50.426825 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:50.436534 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:50.436983 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:50.437741 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:50.438168 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:50.580277 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:50.591754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bd580f74-0aeb-466b-9cc9-35d75a20dd3c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1678 microversion: 2.1 time: 0.172487 Apr 01 10:09:50.592519 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 259/526] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:50 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:51.618417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:51.619463 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:51.627877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:51.628323 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:51.629087 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:51.629518 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:51.777905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:51.785896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f0b29483-643f-47a1-8039-5bd16f3e7c95 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1655 microversion: 2.1 time: 0.173994 Apr 01 10:09:51.786468 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 268/527] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:51 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1655 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:51.802812 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1c603b46-5adf-4367-bb57-4e3436ea8bca tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:51.809730 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c603b46-5adf-4367-bb57-4e3436ea8bca tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:51.810192 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c603b46-5adf-4367-bb57-4e3436ea8bca tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:51.831257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1c603b46-5adf-4367-bb57-4e3436ea8bca tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Going to try to start instance {{(pid=117065) start /opt/stack/nova/nova/compute/api.py:2730}} Apr 01 10:09:51.877662 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1c603b46-5adf-4367-bb57-4e3436ea8bca tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action" status: 202 len: 0 microversion: 2.1 time: 0.078639 Apr 01 10:09:51.878459 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 260/528] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:09:51 2022] POST /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:09:51.886877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:51.887484 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:51.893680 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:51.894281 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:51.895000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:51.895416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:52.031711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:52.039607 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-949627f7-0522-4ed8-bc49-09db58667417 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1664 microversion: 2.1 time: 0.156666 Apr 01 10:09:52.040188 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 269/529] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:51 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:52.155682 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-695b6a04-b827-400d-a5ed-df42742d8d55 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:09:52.156804 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-695b6a04-b827-400d-a5ed-df42742d8d55 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:52.165570 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-695b6a04-b827-400d-a5ed-df42742d8d55 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:52.166018 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-695b6a04-b827-400d-a5ed-df42742d8d55 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:52.166814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-695b6a04-b827-400d-a5ed-df42742d8d55 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:52.167261 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-695b6a04-b827-400d-a5ed-df42742d8d55 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:52.241451 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-695b6a04-b827-400d-a5ed-df42742d8d55 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/action" status: 202 len: 0 microversion: 2.1 time: 0.089977 Apr 01 10:09:52.242278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 261/530] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:09:52 2022] POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:09:52.250796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:52.251404 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:52.258862 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:52.259583 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:52.260403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:52.260919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:52.505169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:52.514728 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-bf059604-bfee-4463-8e66-b3619dc30aa6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1751 microversion: 2.1 time: 0.268050 Apr 01 10:09:52.515916 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 270/531] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:52 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1751 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:53.058290 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:53.059028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:53.065479 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:53.065930 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:53.066735 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:53.067170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:53.210762 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:53.218768 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5fa6073f-5bbd-4e47-a3cd-43e8e3890532 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1664 microversion: 2.1 time: 0.165183 Apr 01 10:09:53.219376 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 262/532] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:53 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1664 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:53.533539 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:53.534154 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:53.541155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:53.541604 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:53.542370 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:53.542844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:53.703790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:53.717220 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ef9f7f25-1a48-4c56-9683-4014da35cced tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.187444 Apr 01 10:09:53.718167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 271/533] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:53 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:54.237942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:54.238614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:54.246135 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:54.246634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:54.247529 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:54.248010 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:54.386914 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:54.394945 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5f662cd5-a9b3-4b6b-9300-953639f89463 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1668 microversion: 2.1 time: 0.161431 Apr 01 10:09:54.395520 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 263/534] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:54 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1668 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:54.745038 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:54.745940 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:54.753542 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:54.753991 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:54.754793 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:54.755215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:54.909486 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:54.920678 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b53601d2-cc73-4def-811c-9444650cff1c tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.182641 Apr 01 10:09:54.921242 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 272/535] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:54 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:55.942015 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:55.943135 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:55.952600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:55.953052 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:55.953816 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:55.954247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:56.116774 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:56.125054 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-15bcf6eb-01a0-4b0b-9b60-a5ea99d30b94 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.189511 Apr 01 10:09:56.125627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 264/536] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:55 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:57.145837 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:57.147052 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:57.156190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:57.156646 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:57.157416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:57.157848 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:57.312320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:57.324269 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7a37e7e2-b4db-4424-af5b-dc81bfc3996b tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.185024 Apr 01 10:09:57.325105 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 273/537] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:57 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:58.347294 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:58.347923 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:58.356009 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:58.356575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:58.357748 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:58.358351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:58.510546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:58.518893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-082f3aeb-bcc6-4b83-88dd-92818250df18 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.176230 Apr 01 10:09:58.519461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 265/538] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:58 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:09:59.537436 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:09:59.538296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:09:59.547047 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:59.547496 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:59.548260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:09:59.548690 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:09:59.708570 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:09:59.722233 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-209f8c16-1a56-44ed-a388-1bb49fe83541 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.188990 Apr 01 10:09:59.723443 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 274/539] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:09:59 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:00.748311 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:00.749416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:00.756047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:00.756502 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:00.757277 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:00.757713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:00.908641 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:00.920768 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c4be66bd-bfe4-4359-9a0a-69b0ee56c977 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.178816 Apr 01 10:10:00.921511 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 266/540] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:00 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:01.942389 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:01.943546 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:01.953821 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:01.954280 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:01.955076 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:01.955501 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:02.103965 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:02.112732 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d149ed21-b40a-4849-8743-88042bd8d566 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.176694 Apr 01 10:10:02.113298 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 275/541] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:01 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:03.129800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:03.130383 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:03.138185 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:03.138670 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:03.139908 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:03.140929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:03.293781 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:03.302496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-599fc035-0a17-4898-baed-6dd7083c61b5 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.176741 Apr 01 10:10:03.303102 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 267/542] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:03 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:04.377435 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:04.378055 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:04.385570 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:04.386014 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:04.386796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:04.387219 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:04.544206 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:04.552906 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-767f85a4-4091-4296-b0ca-22287a5973cf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.179453 Apr 01 10:10:04.553492 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 276/543] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:04 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:05.576860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:05.577869 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:05.586325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:05.586811 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:05.587580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:05.588015 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:05.742700 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:05.751711 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f48e97a1-2785-4be9-bedf-9abc7db592bf tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.181382 Apr 01 10:10:05.752285 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 268/544] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:05 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:06.770778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:06.771410 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:06.779140 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:06.779667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:06.780568 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:06.781085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:06.927787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:06.936059 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2a1279ed-09e7-47e3-b916-fb5102126cc2 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.169943 Apr 01 10:10:06.936641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 277/545] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:06 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:07.957582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:07.958712 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:07.969575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:07.970275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:07.971100 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:07.971534 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:08.132707 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:08.141118 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-445588c9-c3c3-4fb0-90a4-fe918d720ae6 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1756 microversion: 2.1 time: 0.190111 Apr 01 10:10:08.141704 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 269/546] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:07 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1756 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:09.162357 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:09.163326 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:09.173597 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:09.174279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:09.175400 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:09.175829 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:09.329645 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:09.338091 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c1d85eab-ff97-4f34-84de-c37d3e3b27b8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1759 microversion: 2.1 time: 0.182023 Apr 01 10:10:09.338676 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 278/547] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:09 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1759 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:22.434604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:22.435230 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:22.441821 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:22.442272 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:22.443086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:22.443516 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:22.466352 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lazy-loading 'flavor' on Instance uuid 50585cb5-8edf-45ce-833d-3109010a299e {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:10:22.545937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1422035b-23b1-4432-8527-b4f55d144bde tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "POST /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e/action" status: 202 len: 0 microversion: 2.1 time: 0.115730 Apr 01 10:10:22.546480 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 270/548] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:10:22 2022] POST /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:10:22.555719 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:22.556469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:22.562746 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:22.563243 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:22.564143 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:22.564687 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:22.702325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:22.710124 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-08c2d49f-98ef-45b7-913c-d6d11e883321 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.158543 Apr 01 10:10:22.710696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 279/549] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:22 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:23.732547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:23.733351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:23.741178 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:23.741697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:23.742588 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:23.743134 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:23.892117 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:23.899900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-fe9cc772-6a9f-4e33-bc1a-aeaaa4c60785 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.174156 Apr 01 10:10:23.900494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 271/550] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:23 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:24.456797 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1bd7100b-7b43-4a8e-b54c-5140f9b5e886 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:24.457581 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1bd7100b-7b43-4a8e-b54c-5140f9b5e886 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:24.466095 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1bd7100b-7b43-4a8e-b54c-5140f9b5e886 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.466554 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1bd7100b-7b43-4a8e-b54c-5140f9b5e886 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:24.467372 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1bd7100b-7b43-4a8e-b54c-5140f9b5e886 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.467822 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1bd7100b-7b43-4a8e-b54c-5140f9b5e886 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:24.500774 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1bd7100b-7b43-4a8e-b54c-5140f9b5e886 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments/87eb331a-59bc-4f13-b6ab-aa861b239089" status: 200 len: 194 microversion: 2.20 time: 0.152914 Apr 01 10:10:24.503798 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 280/551] 10.222.0.46 () {60 vars in 1453 bytes} [Fri Apr 1 10:10:24 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments/87eb331a-59bc-4f13-b6ab-aa861b239089 => generated 194 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:10:24.567695 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:24.568194 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:24.574932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.575384 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:24.576159 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.576592 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:24.654835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lazy-loading 'services' on Instance uuid f0c911a2-ef42-4d2a-bea9-a6c56575559f {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:10:24.729728 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4d639fef-50ce-4b71-92b1-6b444ecb7f6c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments/87eb331a-59bc-4f13-b6ab-aa861b239089" status: 202 len: 0 microversion: 2.20 time: 0.165955 Apr 01 10:10:24.730323 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 272/552] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 1 10:10:24 2022] DELETE /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments/87eb331a-59bc-4f13-b6ab-aa861b239089 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:10:24.739622 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-da909757-ed99-4b86-8548-1ee33634b8bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:24.740593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-da909757-ed99-4b86-8548-1ee33634b8bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:24.747207 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da909757-ed99-4b86-8548-1ee33634b8bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.747587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da909757-ed99-4b86-8548-1ee33634b8bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:24.748476 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da909757-ed99-4b86-8548-1ee33634b8bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.749103 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-da909757-ed99-4b86-8548-1ee33634b8bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:24.779586 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-da909757-ed99-4b86-8548-1ee33634b8bd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044186 Apr 01 10:10:24.780145 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 281/553] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Apr 1 10:10:24 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:10:24.927554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:24.928690 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:24.939940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.940738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:24.942004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:24.942718 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:25.085103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:25.097002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2abb27d4-ab81-49b4-81cd-0feeabcc8f12 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.176234 Apr 01 10:10:25.097878 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 273/554] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:24 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:25.791393 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-899ede02-c67f-4e05-aa04-454a76bc7bb2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:25.792231 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-899ede02-c67f-4e05-aa04-454a76bc7bb2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:25.799287 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-899ede02-c67f-4e05-aa04-454a76bc7bb2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:25.799742 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-899ede02-c67f-4e05-aa04-454a76bc7bb2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:25.800524 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-899ede02-c67f-4e05-aa04-454a76bc7bb2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:25.800960 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-899ede02-c67f-4e05-aa04-454a76bc7bb2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:25.829885 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-899ede02-c67f-4e05-aa04-454a76bc7bb2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042762 Apr 01 10:10:25.830438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 282/555] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Apr 1 10:10:25 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:25.888252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:25.888746 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:25.895064 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:25.895518 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:25.896280 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:25.896713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:25.926758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:10:26.009290 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c259f356-7285-44e4-86fd-82685629c96b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 204 len: 0 microversion: 2.20 time: 0.124951 Apr 01 10:10:26.010022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 274/556] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 1 10:10:25 2022] DELETE /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 01 10:10:26.018903 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:26.019509 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:26.025440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:26.025880 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:26.026679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:26.027100 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:26.118010 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:26.118724 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:26.124963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:26.125405 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:26.126173 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:26.126599 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:26.168025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:26.176121 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:26.177689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:26.178980 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8dec8e2c-1a98-4c68-a13e-0d7c93742949 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.164444 Apr 01 10:10:26.179638 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 283/557] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:26 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:26.261245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:26.269648 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f88a4206-c5e8-43b8-9628-2618b064ad85 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.155922 Apr 01 10:10:26.270268 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 275/558] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:26 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:10:27.200886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:27.201493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:27.208293 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:27.208739 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:27.209500 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:27.209928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:27.286805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:27.287417 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:27.293876 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:27.294340 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:27.295212 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:27.295651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:27.348252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:27.356531 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:27.358380 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:27.359612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-109c8692-404c-4df1-9395-e82a33e8811f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.165063 Apr 01 10:10:27.361244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 284/559] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:27 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:27.445625 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:27.454077 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3516b079-e278-432a-beae-2a002d26d50e tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.171072 Apr 01 10:10:27.454555 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 276/560] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:27 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:28.378356 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:28.378989 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:28.385792 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:28.386260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:28.387085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:28.387541 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:28.471681 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:28.472299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:28.478802 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:28.479260 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:28.480030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:28.480463 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:28.625124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:28.633076 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-419e8439-f04a-4f06-8fba-3b1fb7c571ed tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.165381 Apr 01 10:10:28.636330 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:28.642875 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 277/561] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:28 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:28.645042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:28.646538 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:28.647758 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9e19d611-4a52-42d1-952d-ea4b7f85ff8f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 200 len: 1724 microversion: 2.20 time: 0.273674 Apr 01 10:10:28.648308 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 285/562] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:28 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 1724 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:29.035940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-ef8df4cb-cbe8-4932-a679-6c7d323edfbb req-7a9166aa-34dc-42d7-a82f-2214645a4b58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0c911a2-ef42-4d2a-bea9-a6c56575559f", "name": "network-vif-deleted", "tag": "b8c404b8-1348-40f2-87ab-56e8fc6c155a"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:29.045673 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-ef8df4cb-cbe8-4932-a679-6c7d323edfbb req-7a9166aa-34dc-42d7-a82f-2214645a4b58 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:29.046205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-ef8df4cb-cbe8-4932-a679-6c7d323edfbb req-7a9166aa-34dc-42d7-a82f-2214645a4b58 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:29.057986 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-ef8df4cb-cbe8-4932-a679-6c7d323edfbb req-7a9166aa-34dc-42d7-a82f-2214645a4b58 service nova] Creating event network-vif-deleted:b8c404b8-1348-40f2-87ab-56e8fc6c155a for instance f0c911a2-ef42-4d2a-bea9-a6c56575559f on hv-cinder-maste Apr 01 10:10:29.064159 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-ef8df4cb-cbe8-4932-a679-6c7d323edfbb req-7a9166aa-34dc-42d7-a82f-2214645a4b58 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031502 Apr 01 10:10:29.065329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 278/563] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:29.650694 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:29.651327 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:29.657736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:29.658190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:29.660484 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:29.660931 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:29.666935 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:29.667829 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:29.675547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:29.676359 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:29.677371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:29.677898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:29.691483 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] HTTP exception thrown: Instance f0c911a2-ef42-4d2a-bea9-a6c56575559f could not be found. Apr 01 10:10:29.692242 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Returning 404 to user: Instance f0c911a2-ef42-4d2a-bea9-a6c56575559f could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:10:29.693295 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f37c33a3-b834-4dd1-9ee0-aa1735f84bcd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 404 len: 111 microversion: 2.20 time: 0.031351 Apr 01 10:10:29.694302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 279/564] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:29 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:10:29.703070 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cd353bbc-236b-4d52-86dc-69aeb90a8a0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '.version_select at 0x7f64ed8a2af0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:29.707128 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: ERROR oslo.messaging._drivers.impl_rabbit [None req-cd353bbc-236b-4d52-86dc-69aeb90a8a0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [9c4ee761-9652-44c6-aa4b-78a60a300a02] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 01 10:10:29.801089 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:29.808791 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6972fbc6-809e-4258-9a5c-650abf050b46 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.161964 Apr 01 10:10:29.809505 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 286/565] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:29 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:30.715656 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [None req-cd353bbc-236b-4d52-86dc-69aeb90a8a0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [9c4ee761-9652-44c6-aa4b-78a60a300a02] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 53652. Apr 01 10:10:30.739020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cd353bbc-236b-4d52-86dc-69aeb90a8a0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587481964" status: 204 len: 0 microversion: 2.20 time: 1.040442 Apr 01 10:10:30.739638 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 280/566] 10.222.0.46 () {60 vars in 1258 bytes} [Fri Apr 1 10:10:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587481964 => generated 0 bytes in 1042 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 01 10:10:30.825942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:30.827262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:30.833740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:30.834271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:30.835082 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:30.835509 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:31.099748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:31.109501 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e5638d4b-ff10-47c8-bd34-20df297b1a13 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.287506 Apr 01 10:10:31.110323 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 287/567] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:30 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:31.465068 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ac6f446a-322a-457b-b1df-9fec463f09b4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'create', calling method: .version_select at 0x7f64eda7aee0>, body: {"keypair": {"name": "tempest-keypair-1752989184"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:31.479504 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-ac6f446a-322a-457b-b1df-9fec463f09b4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:10:31.483453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-ac6f446a-322a-457b-b1df-9fec463f09b4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for user a0661916b4064097a834dcef7e02b3ee and project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:10:31.923734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-ac6f446a-322a-457b-b1df-9fec463f09b4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:10:31.927422 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-ac6f446a-322a-457b-b1df-9fec463f09b4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for user a0661916b4064097a834dcef7e02b3ee and project 984d4a492510482d88f7aec954117969. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:10:31.940327 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ac6f446a-322a-457b-b1df-9fec463f09b4 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 0.479164 Apr 01 10:10:31.940946 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 281/568] 10.222.0.46 () {62 vars in 1198 bytes} [Fri Apr 1 10:10:31 2022] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 480 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Apr 01 10:10:32.127574 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:32.128223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:32.134946 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:32.135392 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:32.136160 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:32.136584 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:32.323811 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:32.332576 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c1353b99-b5e4-4990-98ea-bf01781ecb5b tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.209027 Apr 01 10:10:32.333485 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 288/569] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:32 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:33.253189 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-750206220", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e9d4a0c-1d37-47c8-938f-aa4da0ee4052"}], "security_groups": [{"name": "tempest-securitygroup--1084261483"}], "key_name": "tempest-keypair-1752989184", "user_data": "}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:33.349793 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:33.350407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:33.356944 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:33.357446 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:33.358215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:33.358642 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:33.363143 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] validate_networks() for [('2e9d4a0c-1d37-47c8-938f-aa4da0ee4052', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:10:33.497778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:33.505300 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b90322ff-e855-42fc-ac64-a57653924239 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.159871 Apr 01 10:10:33.505873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 289/570] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:33 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:10:33.777584 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:10:33.778171 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:10:33.778886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:10:33.779380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:10:33.779790 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:10:33.789355 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:33.789730 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:33.790530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:33.790993 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:33.807798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for project 984d4a492510482d88f7aec954117969. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:10:33.812259 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Getting quotas for user a0661916b4064097a834dcef7e02b3ee and project 984d4a492510482d88f7aec954117969. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:10:33.824924 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:10:33.827243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:10:33.887307 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e8dfdb71-73c1-4acb-89ac-052d16988ebd tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.638599 Apr 01 10:10:33.888461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 282/571] 10.222.0.46 () {62 vars in 1187 bytes} [Fri Apr 1 10:10:33 2022] POST /compute/v2.1/servers => generated 402 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Apr 01 10:10:33.899139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9b13c354-5cb4-4241-89dc-409b195e3922 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:33.899746 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9b13c354-5cb4-4241-89dc-409b195e3922 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:33.950953 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9b13c354-5cb4-4241-89dc-409b195e3922 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:33.958178 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9b13c354-5cb4-4241-89dc-409b195e3922 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:33.959697 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9b13c354-5cb4-4241-89dc-409b195e3922 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:33.960803 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9b13c354-5cb4-4241-89dc-409b195e3922 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1281 microversion: 2.20 time: 0.065588 Apr 01 10:10:33.961359 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 290/572] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:33 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1281 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:34.525361 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:34.526028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:34.533476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:34.533920 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:34.534740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:34.535172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:34.683699 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:34.691471 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5a836a00-51c4-435d-bc7a-7395390f5642 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.172490 Apr 01 10:10:34.692068 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 283/573] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:34 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:34.980997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:34.981616 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:34.988838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:34.989285 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:34.990051 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:34.990478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:35.079109 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:35.090273 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:35.094224 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:35.095627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-71bd642e-5d9c-424f-b6d2-c55865030019 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1333 microversion: 2.20 time: 0.119771 Apr 01 10:10:35.106316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 291/574] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:34 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1333 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:35.708987 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:35.709604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:35.716357 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:35.716815 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:35.717584 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:35.718089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:35.866805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:35.874367 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7303905e-7ea9-48df-a580-b7cf2595c713 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1570 microversion: 2.1 time: 0.169398 Apr 01 10:10:35.885613 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 284/575] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:35 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:35.891701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3bb29b8a-953e-4124-9f12-9118098c9a8f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:35.892269 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3bb29b8a-953e-4124-9f12-9118098c9a8f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:35.900414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3bb29b8a-953e-4124-9f12-9118098c9a8f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:35.900862 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3bb29b8a-953e-4124-9f12-9118098c9a8f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:35.901638 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3bb29b8a-953e-4124-9f12-9118098c9a8f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:35.902069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3bb29b8a-953e-4124-9f12-9118098c9a8f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:35.999844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3bb29b8a-953e-4124-9f12-9118098c9a8f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "POST /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e/action" status: 202 len: 0 microversion: 2.1 time: 0.112385 Apr 01 10:10:36.000485 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 292/576] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:10:35 2022] POST /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:10:36.011250 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:36.011979 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:36.019040 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:36.020038 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:36.021234 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:36.021740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:36.114211 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:36.114863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:36.127922 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:36.128612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:36.129585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:36.130036 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:36.215197 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:36.223008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-de568387-1003-4d0c-a9b8-9000b9257ce6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1518 microversion: 2.1 time: 0.216774 Apr 01 10:10:36.232999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 285/577] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:36 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1518 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:36.452026 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:36.460319 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:36.461798 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:36.462942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ff83cdfc-d029-4e05-bacf-9759dc56845b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.352903 Apr 01 10:10:36.463530 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 293/578] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:36 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:10:36.812215 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-deb179c0-ad08-458e-86c5-2bbd39f8b98c req-520e4699-6703-4fbc-a99c-5a3dbb118e7d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b5d9e-6bee-443c-86e3-94e71c99643d", "tag": "29223cc6-236b-47ca-8914-e65111046089"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:36.832170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-deb179c0-ad08-458e-86c5-2bbd39f8b98c req-520e4699-6703-4fbc-a99c-5a3dbb118e7d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:36.832885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-deb179c0-ad08-458e-86c5-2bbd39f8b98c req-520e4699-6703-4fbc-a99c-5a3dbb118e7d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:36.850319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-deb179c0-ad08-458e-86c5-2bbd39f8b98c req-520e4699-6703-4fbc-a99c-5a3dbb118e7d service nova] Creating event network-changed:29223cc6-236b-47ca-8914-e65111046089 for instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d on hv-cinder-maste Apr 01 10:10:36.856181 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-deb179c0-ad08-458e-86c5-2bbd39f8b98c req-520e4699-6703-4fbc-a99c-5a3dbb118e7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047834 Apr 01 10:10:36.856951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 286/579] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:37.240203 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:37.240815 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:37.248167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:37.248618 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:37.249439 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:37.249907 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:37.478422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:37.481471 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:37.482131 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:37.486875 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f130e82b-a20d-41d5-b0b5-f4aa8fca16fe tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1520 microversion: 2.1 time: 0.250560 Apr 01 10:10:37.493508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 294/580] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:37 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1520 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:37.494419 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:37.494419 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:37.494419 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:37.494419 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:37.626122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:37.634008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:37.635544 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:37.636680 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3559e3ca-441c-4217-a0d1-6056a9b696ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.159366 Apr 01 10:10:37.637247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 287/581] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:37 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:10:38.504886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:38.505498 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:38.513024 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:38.513474 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:38.514244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:38.515159 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:38.652417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:38.656035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:38.656883 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:38.660211 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2c47a3e8-e51a-4767-a1be-0e9fb4e99c65 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.159309 Apr 01 10:10:38.660798 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 295/582] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:38 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:38.663409 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:38.663861 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:38.664628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:38.665061 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:38.796858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:38.804760 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:38.806256 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:38.807429 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a66af7ba-c88b-482e-ac18-cee7a13106ad tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.155351 Apr 01 10:10:38.807995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 288/583] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:38 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:39.517770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-1c9c40c4-d311-4ac7-a8dc-dca6996e76f8 req-590fd8d1-d144-4a11-9a0d-53dbb279ca5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50585cb5-8edf-45ce-833d-3109010a299e", "name": "network-vif-unplugged", "status": "completed", "tag": "8b587726-e35f-40ca-8c0d-3c4d86c794ce"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:39.525584 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-1c9c40c4-d311-4ac7-a8dc-dca6996e76f8 req-590fd8d1-d144-4a11-9a0d-53dbb279ca5a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:39.526017 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-1c9c40c4-d311-4ac7-a8dc-dca6996e76f8 req-590fd8d1-d144-4a11-9a0d-53dbb279ca5a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:39.538163 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-1c9c40c4-d311-4ac7-a8dc-dca6996e76f8 req-590fd8d1-d144-4a11-9a0d-53dbb279ca5a service nova] Creating event network-vif-unplugged:8b587726-e35f-40ca-8c0d-3c4d86c794ce for instance 50585cb5-8edf-45ce-833d-3109010a299e on hv-cinder-maste Apr 01 10:10:39.543212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-1c9c40c4-d311-4ac7-a8dc-dca6996e76f8 req-590fd8d1-d144-4a11-9a0d-53dbb279ca5a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.086671 Apr 01 10:10:39.543806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 296/584] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:39.681726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:39.682731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:39.691273 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:39.691714 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:39.692479 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:39.692895 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:39.826819 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:39.827693 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:39.834254 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:39.834703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:39.835507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:39.835939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:39.842819 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:39.850529 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c108a09b-ed8b-463f-908d-4de1b92ee958 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.175461 Apr 01 10:10:39.851177 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 289/585] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:39 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:39.974573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:39.982666 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:39.984206 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:39.985318 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5f2a4101-82a7-4027-80d4-f837ecede0d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.163364 Apr 01 10:10:39.985873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 297/586] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:39 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:40.872415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:40.873264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:40.884191 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:40.885009 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:40.886286 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:40.887059 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:41.003678 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:41.004251 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:41.010769 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:41.011223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:41.012025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:41.012458 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:41.026385 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:41.034350 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0dd81f5f-868b-4ab2-86a1-dc0f40545889 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.168730 Apr 01 10:10:41.034960 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 290/587] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:40 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:41.149707 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:41.158460 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:41.160006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:41.161115 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5542da9b-d8f0-4e8b-a33f-1a14730f144d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.161393 Apr 01 10:10:41.161654 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 298/588] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:40 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:10:42.052237 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:42.052995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:42.059978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:42.060431 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:42.061211 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:42.061650 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:42.179954 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:42.180655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:42.187249 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:42.187706 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:42.188483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:42.188920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:42.201643 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:42.209112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-528bca53-5cba-431e-9ea8-d22c7d758b62 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.161253 Apr 01 10:10:42.209688 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 291/589] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:42 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:42.325753 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:42.334667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:42.336170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:42.337279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b1293ed6-1638-4b03-bf47-138c3dfbe44a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.161365 Apr 01 10:10:42.337847 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 299/590] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:42 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:10:42.930881 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:42.931363 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:42.937386 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:42.937844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:42.938621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:42.939080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.017310 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lazy-loading 'services' on Instance uuid 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:10:43.092067 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-91173a1e-6d86-498e-a70c-e8c99d08b4ad tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments/17665e95-c58c-47fe-bd81-b224ff27ac9a" status: 202 len: 0 microversion: 2.1 time: 0.165963 Apr 01 10:10:43.092853 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 292/591] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:10:42 2022] DELETE /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments/17665e95-c58c-47fe-bd81-b224ff27ac9a => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:10:43.101147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8bba688c-d814-4842-9aac-47196f2cbf39 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:43.102065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8bba688c-d814-4842-9aac-47196f2cbf39 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:43.108294 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8bba688c-d814-4842-9aac-47196f2cbf39 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:43.108814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8bba688c-d814-4842-9aac-47196f2cbf39 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.109820 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8bba688c-d814-4842-9aac-47196f2cbf39 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:43.110252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8bba688c-d814-4842-9aac-47196f2cbf39 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.140375 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8bba688c-d814-4842-9aac-47196f2cbf39 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043041 Apr 01 10:10:43.140926 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 300/592] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:10:43 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:43.231084 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:43.232293 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:43.243163 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:43.243906 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.245170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:43.245889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.355344 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:43.356046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:43.362924 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:43.363503 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.364378 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:43.364906 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.395531 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:43.402996 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1a7f1572-e6de-4c49-b096-0b3b05742672 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.178928 Apr 01 10:10:43.404134 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 293/593] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:43 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:43.501666 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:43.509539 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:43.511066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:43.512239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3b3ba9f3-0f36-4420-b04b-fba3c730f5c5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.160857 Apr 01 10:10:43.512805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 301/594] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:43 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:43.524235 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-ef462300-fb63-480a-a1a9-a8949c5a4b4a req-2e564bbf-d8e4-4ce0-b264-6a5cc3b09155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b5d9e-6bee-443c-86e3-94e71c99643d", "name": "network-vif-plugged", "status": "completed", "tag": "29223cc6-236b-47ca-8914-e65111046089"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:43.532297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-ef462300-fb63-480a-a1a9-a8949c5a4b4a req-2e564bbf-d8e4-4ce0-b264-6a5cc3b09155 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:43.532778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-ef462300-fb63-480a-a1a9-a8949c5a4b4a req-2e564bbf-d8e4-4ce0-b264-6a5cc3b09155 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:43.544628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-ef462300-fb63-480a-a1a9-a8949c5a4b4a req-2e564bbf-d8e4-4ce0-b264-6a5cc3b09155 service nova] Creating event network-vif-plugged:29223cc6-236b-47ca-8914-e65111046089 for instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d on hv-cinder-maste Apr 01 10:10:43.549648 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-ef462300-fb63-480a-a1a9-a8949c5a4b4a req-2e564bbf-d8e4-4ce0-b264-6a5cc3b09155 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029113 Apr 01 10:10:43.550471 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 294/595] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:44.155133 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2d43b0d5-de86-4446-a19d-cea0ec87c7c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:44.156203 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2d43b0d5-de86-4446-a19d-cea0ec87c7c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:44.162458 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2d43b0d5-de86-4446-a19d-cea0ec87c7c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.162942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2d43b0d5-de86-4446-a19d-cea0ec87c7c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.163716 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2d43b0d5-de86-4446-a19d-cea0ec87c7c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.164149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2d43b0d5-de86-4446-a19d-cea0ec87c7c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.192169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2d43b0d5-de86-4446-a19d-cea0ec87c7c9 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043416 Apr 01 10:10:44.192740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 302/596] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:10:44 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:10:44.271054 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:44.271661 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:44.278215 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.278672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.279454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.279885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.303468 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:10:44.383348 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4c67216b-9c81-4d12-a3b9-901bbec215c3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "DELETE /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 204 len: 0 microversion: 2.1 time: 0.116168 Apr 01 10:10:44.384160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 295/597] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:10:44 2022] DELETE /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:10:44.392803 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:44.393416 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:44.399606 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.400085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.400838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.401268 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.420171 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:44.420812 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:44.426936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.427391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.428162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.428598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.539029 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:44.546696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-03909d3e-213a-45c2-9907-85464fcb979f tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1690 microversion: 2.1 time: 0.158129 Apr 01 10:10:44.547348 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 303/598] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:44 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1690 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:44.551997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:44.552591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:44.558766 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.559214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.559978 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:44.560401 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:44.583440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:44.590975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6dd94a0c-1e78-4170-84dc-b4a80b738007 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.175176 Apr 01 10:10:44.591547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 296/599] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:44 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:44.694377 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:44.706360 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:44.708716 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:44.710330 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-04cf5c78-f247-4117-ac12-4c5be0e783f3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1407 microversion: 2.20 time: 0.161603 Apr 01 10:10:44.711179 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 304/600] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:44 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:45.568076 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:45.569072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:45.579723 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.580478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:45.581733 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.582461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:45.607383 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:45.608069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:45.614812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.615352 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:45.616166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.616665 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:45.719656 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:45.727001 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cb220b2c-aa4c-4184-be01-9fb727e3b719 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1690 microversion: 2.1 time: 0.165616 Apr 01 10:10:45.727584 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 297/601] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:45 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1690 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:45.732054 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:45.732654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:45.738504 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.738975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:45.739752 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.740177 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:45.749296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:45.757173 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3c2565b5-d437-4033-96f6-9e4e300afe41 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.153755 Apr 01 10:10:45.757774 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 305/602] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:45 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:45.874806 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:45.883131 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:45.884634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:45.885818 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-09da03f6-87b3-4cab-80ca-71cdb97a7ce1 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1599 microversion: 2.20 time: 0.157271 Apr 01 10:10:45.886395 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 298/603] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:10:45 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1599 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:10:45.904153 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6ff497f2-aab5-4bf2-83ab-869e56168945 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:45.904641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6ff497f2-aab5-4bf2-83ab-869e56168945 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:45.910863 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6ff497f2-aab5-4bf2-83ab-869e56168945 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.911316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6ff497f2-aab5-4bf2-83ab-869e56168945 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:45.912074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6ff497f2-aab5-4bf2-83ab-869e56168945 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:45.912514 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6ff497f2-aab5-4bf2-83ab-869e56168945 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:46.004050 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6ff497f2-aab5-4bf2-83ab-869e56168945 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103931 Apr 01 10:10:46.004652 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 306/604] 10.222.0.46 () {60 vars in 1315 bytes} [Fri Apr 1 10:10:45 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:10:46.745600 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:46.746253 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:46.753908 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:46.754358 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:46.755166 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:46.755595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:46.774413 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:46.775075 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:46.781371 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:46.782084 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:46.782749 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:46.783106 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:46.909941 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:46.918322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1de3ea68-2701-493a-9ded-b276affcec24 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1690 microversion: 2.1 time: 0.177659 Apr 01 10:10:46.918926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 299/605] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:46 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1690 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:47.227852 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:47.237477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-45cd1962-525b-413b-afde-00cba36947c1 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1576 microversion: 2.1 time: 0.467236 Apr 01 10:10:47.245980 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 307/606] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:46 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1576 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:10:47.270445 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-1f06f521-8ae0-4c16-b8e3-989b198ed634 req-37ccf7cb-c5d4-47db-8736-f2b78adcf18a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b6b5d9e-6bee-443c-86e3-94e71c99643d", "tag": "29223cc6-236b-47ca-8914-e65111046089"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:47.279358 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-1f06f521-8ae0-4c16-b8e3-989b198ed634 req-37ccf7cb-c5d4-47db-8736-f2b78adcf18a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:47.279804 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-1f06f521-8ae0-4c16-b8e3-989b198ed634 req-37ccf7cb-c5d4-47db-8736-f2b78adcf18a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:47.292031 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-1f06f521-8ae0-4c16-b8e3-989b198ed634 req-37ccf7cb-c5d4-47db-8736-f2b78adcf18a service nova] Creating event network-changed:29223cc6-236b-47ca-8914-e65111046089 for instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d on hv-cinder-maste Apr 01 10:10:47.297123 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-1f06f521-8ae0-4c16-b8e3-989b198ed634 req-37ccf7cb-c5d4-47db-8736-f2b78adcf18a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031396 Apr 01 10:10:47.297904 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 300/607] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:47.935688 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:47.936454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:47.943197 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:47.943902 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:47.945482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:47.946069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:48.087745 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:48.095394 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3f91abe4-4655-42fd-b309-882f7559ac00 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1690 microversion: 2.1 time: 0.163463 Apr 01 10:10:48.095973 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 308/608] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:47 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1690 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:48.255124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:48.255826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:48.267127 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:48.267908 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:48.268758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:48.269204 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:48.428983 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:48.437524 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8ab769cc-f318-463e-996a-8089dcba4397 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1563 microversion: 2.1 time: 0.186583 Apr 01 10:10:48.439777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 301/609] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:48 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1563 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:49.112179 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:49.112790 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:49.119533 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:49.119975 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:49.120870 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:49.121296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:49.255871 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:49.263848 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-39ceb89c-c383-435c-a39d-26f0d94184dc tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 200 len: 1690 microversion: 2.1 time: 0.155568 Apr 01 10:10:49.264749 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 309/610] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:49 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:49.600785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-603667b6-28e5-471d-a8ec-50d6f0a72c6d req-afd6036b-6c4a-4c78-925f-e01aec05ab50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50585cb5-8edf-45ce-833d-3109010a299e", "name": "network-vif-plugged", "status": "completed", "tag": "8b587726-e35f-40ca-8c0d-3c4d86c794ce"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:49.617647 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-603667b6-28e5-471d-a8ec-50d6f0a72c6d req-afd6036b-6c4a-4c78-925f-e01aec05ab50 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:49.618165 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-603667b6-28e5-471d-a8ec-50d6f0a72c6d req-afd6036b-6c4a-4c78-925f-e01aec05ab50 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:49.630903 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-603667b6-28e5-471d-a8ec-50d6f0a72c6d req-afd6036b-6c4a-4c78-925f-e01aec05ab50 service nova] Creating event network-vif-plugged:8b587726-e35f-40ca-8c0d-3c4d86c794ce for instance 50585cb5-8edf-45ce-833d-3109010a299e on hv-cinder-maste Apr 01 10:10:49.637367 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-603667b6-28e5-471d-a8ec-50d6f0a72c6d req-afd6036b-6c4a-4c78-925f-e01aec05ab50 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041176 Apr 01 10:10:49.638114 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 302/611] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:10:49.687949 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-3f653b88-68d5-41f9-978f-7bc8ec0f0ac8 req-39c89369-dc7f-4527-8d99-24e4077aee3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6ff54d32-e02c-4bb8-a3a6-3aec1474f63a", "name": "network-vif-deleted", "tag": "78e92c0d-8920-4d6d-86a9-c78c75d01421"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:49.697877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-3f653b88-68d5-41f9-978f-7bc8ec0f0ac8 req-39c89369-dc7f-4527-8d99-24e4077aee3a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:49.698870 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-3f653b88-68d5-41f9-978f-7bc8ec0f0ac8 req-39c89369-dc7f-4527-8d99-24e4077aee3a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:49.711112 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-3f653b88-68d5-41f9-978f-7bc8ec0f0ac8 req-39c89369-dc7f-4527-8d99-24e4077aee3a service nova] Creating event network-vif-deleted:78e92c0d-8920-4d6d-86a9-c78c75d01421 for instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a on hv-cinder-maste Apr 01 10:10:49.718068 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-3f653b88-68d5-41f9-978f-7bc8ec0f0ac8 req-39c89369-dc7f-4527-8d99-24e4077aee3a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111041 Apr 01 10:10:49.719211 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 310/612] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:10:50.283783 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:50.284391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:50.290985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:50.291533 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:50.292516 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:50.292960 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:50.307081 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] HTTP exception thrown: Instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a could not be found. Apr 01 10:10:50.307636 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Returning 404 to user: Instance 6ff54d32-e02c-4bb8-a3a6-3aec1474f63a could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:10:50.308478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ec8e6534-54ac-4e56-978e-52bfb3208b7a tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a" status: 404 len: 111 microversion: 2.1 time: 0.030405 Apr 01 10:10:50.309035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 303/613] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:50 2022] GET /compute/v2.1/servers/6ff54d32-e02c-4bb8-a3a6-3aec1474f63a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:10:50.318519 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9e55783d-4d0a-406c-8b05-30e7b37ea081 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '.version_select at 0x7f64ed97e4c0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:50.343585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9e55783d-4d0a-406c-8b05-30e7b37ea081 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-656976635" status: 202 len: 0 microversion: 2.1 time: 0.029645 Apr 01 10:10:50.344165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 311/614] 10.222.0.46 () {58 vars in 1217 bytes} [Fri Apr 1 10:10:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-656976635 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:10:53.329461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:53.329998 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:53.336691 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:53.337139 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:53.337897 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:53.338328 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:53.364196 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:10:53.448216 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-10aeefea-d8c3-47bc-9564-18f1a230ce03 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "DELETE /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 204 len: 0 microversion: 2.1 time: 0.122423 Apr 01 10:10:53.449161 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 304/615] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:10:53 2022] DELETE /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:10:53.457993 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:53.458785 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:53.467858 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:53.468435 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:53.469325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:53.469862 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:53.606244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:53.613945 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7355ba06-c0f1-46f0-8782-831bfc33d2d4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1506 microversion: 2.1 time: 0.160338 Apr 01 10:10:53.614586 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 312/616] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:53 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:54.632649 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:54.633352 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:54.641269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:54.641886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:54.643181 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:54.643781 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:54.722729 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:54.731833 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-96edb2f0-cc6a-4adb-b3c4-bfd2a9d8e739 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 200 len: 1464 microversion: 2.1 time: 0.103576 Apr 01 10:10:54.741292 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 305/617] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:54 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 1464 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:54.815566 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-be52a78f-e2b3-40fe-aab0-d1f5756e6879 req-bddf991c-16fb-40bc-9f5e-cea4fba42f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04f542a5-3483-4eb2-8469-e930b23ca65f", "name": "network-vif-deleted", "tag": "e9a85c98-ea8f-41f5-9d37-da82f3c446c0"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:54.824966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-be52a78f-e2b3-40fe-aab0-d1f5756e6879 req-bddf991c-16fb-40bc-9f5e-cea4fba42f5c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:54.825410 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-be52a78f-e2b3-40fe-aab0-d1f5756e6879 req-bddf991c-16fb-40bc-9f5e-cea4fba42f5c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:54.836748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-be52a78f-e2b3-40fe-aab0-d1f5756e6879 req-bddf991c-16fb-40bc-9f5e-cea4fba42f5c service nova] Creating event network-vif-deleted:e9a85c98-ea8f-41f5-9d37-da82f3c446c0 for instance 04f542a5-3483-4eb2-8469-e930b23ca65f on hv-cinder-maste Apr 01 10:10:54.842205 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-be52a78f-e2b3-40fe-aab0-d1f5756e6879 req-bddf991c-16fb-40bc-9f5e-cea4fba42f5c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031424 Apr 01 10:10:54.842888 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 313/618] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:55.752902 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:55.753806 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: 04f542a5-3483-4eb2-8469-e930b23ca65f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:55.765086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:55.765536 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:55.766305 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:55.766773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:55.780071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] HTTP exception thrown: Instance 04f542a5-3483-4eb2-8469-e930b23ca65f could not be found. Apr 01 10:10:55.780658 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Returning 404 to user: Instance 04f542a5-3483-4eb2-8469-e930b23ca65f could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:10:55.781470 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-58534896-cd33-4d98-ae0c-726f1400e4a3 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f" status: 404 len: 111 microversion: 2.1 time: 0.035861 Apr 01 10:10:55.781997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 306/619] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:55 2022] GET /compute/v2.1/servers/04f542a5-3483-4eb2-8469-e930b23ca65f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:10:55.790902 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:55.791473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:55.797987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:55.798442 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:55.799237 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:55.799673 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:55.824099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:10:55.901628 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5f992182-04b9-47c3-bb06-7fdabdc7dfd2 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "DELETE /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 204 len: 0 microversion: 2.1 time: 0.114689 Apr 01 10:10:55.902318 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 314/620] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:10:55 2022] DELETE /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:10:55.910880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:55.911494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:55.917599 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:55.918057 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:55.918860 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:55.919298 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:56.073911 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:56.085275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9574f857-3cc8-4aff-a37d-e6515df37bb4 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.177967 Apr 01 10:10:56.086143 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 307/621] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:55 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:57.109587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:57.110307 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:57.117090 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:57.117547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:57.118331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:57.118907 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:57.255573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:57.266860 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f72bb88b-e2f6-46db-9274-b62ecb427a3d tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.163571 Apr 01 10:10:57.267558 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 315/622] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:57 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:57.964902 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f70532b9-c395-4566-92d4-2e118bde8992 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:57.965872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f70532b9-c395-4566-92d4-2e118bde8992 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:57.972943 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f70532b9-c395-4566-92d4-2e118bde8992 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:57.973403 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f70532b9-c395-4566-92d4-2e118bde8992 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:57.974187 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f70532b9-c395-4566-92d4-2e118bde8992 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:57.974620 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f70532b9-c395-4566-92d4-2e118bde8992 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:58.006007 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f70532b9-c395-4566-92d4-2e118bde8992 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045104 Apr 01 10:10:58.006575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 308/623] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:10:57 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:10:58.065047 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:58.065549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:58.072084 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:58.072532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:58.073308 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:58.073740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:58.097165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:10:58.185631 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cb65df2c-ae4a-48c7-add0-f4bed9027fbd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 204 len: 0 microversion: 2.1 time: 0.124119 Apr 01 10:10:58.186417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 316/624] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:10:58 2022] DELETE /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:10:58.194738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:58.200007 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:58.201870 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:58.202319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:58.203187 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:58.203613 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:58.284568 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:58.285265 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:58.292109 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:58.292109 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:58.292786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:58.293186 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:58.341643 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:58.349124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-829ad4c4-07ab-4909-895f-72f8db12ddbc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1674 microversion: 2.1 time: 0.158474 Apr 01 10:10:58.349691 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 309/625] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:58 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:58.430478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:58.438229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-737e3a8e-2e62-4bcf-a0a3-b71e74ebfd56 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1522 microversion: 2.1 time: 0.157793 Apr 01 10:10:58.438768 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 317/626] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:58 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:10:59.052316 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-8a9d3187-c6f4-4810-9f45-898b77cdad6c req-59c9b3be-ad4d-4c2a-bc9d-4def3e341b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "acf7fba9-5b94-4c19-8f65-5a3a831b3458", "name": "network-vif-deleted", "tag": "7309433f-2298-42e8-bf12-5febdcdd2183"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:10:59.060906 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-8a9d3187-c6f4-4810-9f45-898b77cdad6c req-59c9b3be-ad4d-4c2a-bc9d-4def3e341b4b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:59.061356 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-8a9d3187-c6f4-4810-9f45-898b77cdad6c req-59c9b3be-ad4d-4c2a-bc9d-4def3e341b4b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:59.072978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-8a9d3187-c6f4-4810-9f45-898b77cdad6c req-59c9b3be-ad4d-4c2a-bc9d-4def3e341b4b service nova] Creating event network-vif-deleted:7309433f-2298-42e8-bf12-5febdcdd2183 for instance acf7fba9-5b94-4c19-8f65-5a3a831b3458 on hv-cinder-maste Apr 01 10:10:59.078287 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-8a9d3187-c6f4-4810-9f45-898b77cdad6c req-59c9b3be-ad4d-4c2a-bc9d-4def3e341b4b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029629 Apr 01 10:10:59.079033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 310/627] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:10:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:10:59.366689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:59.367333 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:59.373796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:59.374564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:59.375662 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:59.376063 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:59.459971 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:10:59.460665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:10:59.473416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:59.474183 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:59.475149 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:59.475633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:59.508739 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:10:59.509186 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:10:59.509634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lazy-loading 'fault' on Instance uuid acf7fba9-5b94-4c19-8f65-5a3a831b3458 {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:10:59.523342 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:59.530591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-10a8ea56-5106-4804-bc0d-fe46dd5a00d1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1674 microversion: 2.1 time: 0.167801 Apr 01 10:10:59.531194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 318/628] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:59 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1674 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:10:59.549820 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ca94cdcf3824f56a886b757e41602dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4073e831952c461bb6bb0e6b1137240b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:10:59.557072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d574ace8-0c4a-48ac-bdad-a58da539eb93 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 200 len: 1311 microversion: 2.1 time: 0.101552 Apr 01 10:10:59.557627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 311/629] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:10:59 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:11:00.547711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:00.548278 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:00.554891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:00.555335 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:00.556119 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:00.556547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:00.575133 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:00.575794 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] [instance: acf7fba9-5b94-4c19-8f65-5a3a831b3458] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:00.583315 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:00.583748 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:00.584688 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:00.585127 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:00.599501 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] HTTP exception thrown: Instance acf7fba9-5b94-4c19-8f65-5a3a831b3458 could not be found. Apr 01 10:11:00.600108 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] Returning 404 to user: Instance acf7fba9-5b94-4c19-8f65-5a3a831b3458 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:11:00.601073 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f5a16a61-d3c5-4662-8e25-6fff76b39490 tempest-ServerRescueNegativeTestJSON-653679250 tempest-ServerRescueNegativeTestJSON-653679250-project] 10.222.0.46 "GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458" status: 404 len: 111 microversion: 2.1 time: 0.029989 Apr 01 10:11:00.601913 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 312/630] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:00 2022] GET /compute/v2.1/servers/acf7fba9-5b94-4c19-8f65-5a3a831b3458 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:00.619274 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:00.626802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a2c705bd-ec9f-40f8-83da-2b287f08b694 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 200 len: 1606 microversion: 2.1 time: 0.082914 Apr 01 10:11:00.627663 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 319/631] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:00 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 1606 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:01.095825 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-406fc77c-c4d1-4a99-b467-b07504238761 req-435ea849-7330-4105-b595-fad718522812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7fecc8e1-f340-4be9-8243-7369fcf1dbca", "name": "network-vif-deleted", "tag": "e35a73e3-6163-462e-9549-4a90aec2d584"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:01.104487 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-406fc77c-c4d1-4a99-b467-b07504238761 req-435ea849-7330-4105-b595-fad718522812 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:01.104926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-406fc77c-c4d1-4a99-b467-b07504238761 req-435ea849-7330-4105-b595-fad718522812 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:01.118684 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-406fc77c-c4d1-4a99-b467-b07504238761 req-435ea849-7330-4105-b595-fad718522812 service nova] Creating event network-vif-deleted:e35a73e3-6163-462e-9549-4a90aec2d584 for instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca on hv-cinder-maste Apr 01 10:11:01.123876 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-406fc77c-c4d1-4a99-b467-b07504238761 req-435ea849-7330-4105-b595-fad718522812 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031790 Apr 01 10:11:01.124883 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 313/632] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:11:01.644302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:01.645608 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:01.652358 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:01.652890 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:01.653701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:01.654211 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:01.670090 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] HTTP exception thrown: Instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca could not be found. Apr 01 10:11:01.671535 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Returning 404 to user: Instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:11:01.672728 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-92d40de0-3a9f-4966-a715-b267e5fad240 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 404 len: 111 microversion: 2.1 time: 0.032167 Apr 01 10:11:01.673949 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 320/633] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:01 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:01.685696 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-aebafa95-c82f-4c3a-ad74-6acdba7e770d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '.version_select at 0x7f64edad51f0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:01.704912 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-aebafa95-c82f-4c3a-ad74-6acdba7e770d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-870983360" status: 202 len: 0 microversion: 2.1 time: 0.023290 Apr 01 10:11:01.705896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 314/634] 10.222.0.46 () {58 vars in 1217 bytes} [Fri Apr 1 10:11:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-870983360 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 01 10:11:03.031028 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9182ad6a-93d4-4b3a-82e0-1a5839fcafb4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'create', calling method: .version_select at 0x7f64ed9d4430>, body: {"keypair": {"name": "tempest-keypair-2115188567"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:03.047213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-9182ad6a-93d4-4b3a-82e0-1a5839fcafb4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:11:03.051917 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-9182ad6a-93d4-4b3a-82e0-1a5839fcafb4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for user d6cc94b4e59c4b3ba507cc2e696e1a37 and project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:11:03.164663 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-9182ad6a-93d4-4b3a-82e0-1a5839fcafb4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:11:03.168642 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-9182ad6a-93d4-4b3a-82e0-1a5839fcafb4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for user d6cc94b4e59c4b3ba507cc2e696e1a37 and project 8abd12555c7642749049eaaedec0cbc1. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:11:03.182952 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9182ad6a-93d4-4b3a-82e0-1a5839fcafb4 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.157480 Apr 01 10:11:03.188643 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 321/635] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:11:03 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:05.253854 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1845546393", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b577230f-3445-4ece-839d-d9c1aac044c2"}], "security_groups": [{"name": "tempest-securitygroup--205352835"}], "key_name": "tempest-keypair-2115188567", "user_data": "}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:05.359527 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] validate_networks() for [('b577230f-3445-4ece-839d-d9c1aac044c2', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:11:05.749091 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:11:05.749512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:11:05.750012 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:11:05.750419 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:11:05.750855 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:11:05.760325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:05.760773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:05.761571 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:05.762005 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:05.778991 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for project 8abd12555c7642749049eaaedec0cbc1. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:11:05.783252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Getting quotas for user d6cc94b4e59c4b3ba507cc2e696e1a37 and project 8abd12555c7642749049eaaedec0cbc1. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:11:05.797226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:11:05.799651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:11:05.851184 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-21c369d3-3897-4d3f-b750-1f7fe3edad98 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601753 Apr 01 10:11:05.854750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 315/636] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:11:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:11:05.861968 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-41ecbee8-6880-42be-9483-569135f2e2fd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:05.862770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-41ecbee8-6880-42be-9483-569135f2e2fd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:05.929615 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-41ecbee8-6880-42be-9483-569135f2e2fd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:05.937244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-41ecbee8-6880-42be-9483-569135f2e2fd tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1238 microversion: 2.1 time: 0.079223 Apr 01 10:11:05.937801 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 322/637] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:05 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1238 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:06.953502 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:06.954708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:06.964545 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:06.965000 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:06.966338 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:06.966997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:07.048180 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:07.056425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0f265c40-71dc-4cc6-81ac-0703ac9113de tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1296 microversion: 2.1 time: 0.106742 Apr 01 10:11:07.057089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 316/638] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:06 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:11:08.073338 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:08.074561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:08.081325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:08.081757 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:08.082743 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:08.083164 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:08.245972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:08.254270 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5b07c63b-7c8d-4735-9333-c910e36015e1 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1363 microversion: 2.1 time: 0.184600 Apr 01 10:11:08.255293 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 323/639] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:08 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:08.303093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-3c9afe36-a251-4ce9-91a5-d72c5648753d req-4f6b1c88-2adc-4cad-b7a6-ba36b71e3b85 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857c3a0e-4b47-48d0-a1a6-fe530160b9b9", "tag": "2192815c-21e5-45b9-9276-0015b17f5100"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:08.316614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-3c9afe36-a251-4ce9-91a5-d72c5648753d req-4f6b1c88-2adc-4cad-b7a6-ba36b71e3b85 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:08.317053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-3c9afe36-a251-4ce9-91a5-d72c5648753d req-4f6b1c88-2adc-4cad-b7a6-ba36b71e3b85 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:08.331079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-3c9afe36-a251-4ce9-91a5-d72c5648753d req-4f6b1c88-2adc-4cad-b7a6-ba36b71e3b85 service nova] Creating event network-changed:2192815c-21e5-45b9-9276-0015b17f5100 for instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 on hv-cinder-maste Apr 01 10:11:08.344373 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-3c9afe36-a251-4ce9-91a5-d72c5648753d req-4f6b1c88-2adc-4cad-b7a6-ba36b71e3b85 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044826 Apr 01 10:11:08.345231 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 317/640] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:09.277951 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:09.278817 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:09.286374 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:09.287131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:09.288073 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:09.288600 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:09.421873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:09.431413 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f09d0495-4120-4fa2-b195-8c6d540fcb6b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1363 microversion: 2.1 time: 0.157767 Apr 01 10:11:09.432077 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 324/641] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:09 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1363 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:10.448903 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:10.449708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:10.456447 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:10.456927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:10.457685 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:10.458111 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:10.595369 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:10.602734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-49fdd33f-037a-49d7-8b56-57a351ad33b5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1363 microversion: 2.1 time: 0.158118 Apr 01 10:11:10.603306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 318/642] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:10 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:11.620232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:11.620913 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:11.627645 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:11.628075 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:11.629112 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:11.629794 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:11.766866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:11.786834 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6dc93c16-60fc-4980-9516-5c1f43191868 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1363 microversion: 2.1 time: 0.170395 Apr 01 10:11:11.787210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 325/643] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:11 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:11:12.803264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:12.803876 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:12.810469 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:12.810964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:12.811742 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:12.812180 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:12.946668 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:12.954192 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-53bba24c-c316-487f-8f61-37c40505979d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1363 microversion: 2.1 time: 0.154779 Apr 01 10:11:12.954826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 319/644] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:12 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:13.724263 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-26f1b627-628b-472c-a17a-8416f7eb02c3 req-9b425abe-8b69-47e0-b75b-8f9f8b566f7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857c3a0e-4b47-48d0-a1a6-fe530160b9b9", "name": "network-vif-plugged", "status": "completed", "tag": "2192815c-21e5-45b9-9276-0015b17f5100"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:13.734772 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-26f1b627-628b-472c-a17a-8416f7eb02c3 req-9b425abe-8b69-47e0-b75b-8f9f8b566f7b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:13.735555 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-26f1b627-628b-472c-a17a-8416f7eb02c3 req-9b425abe-8b69-47e0-b75b-8f9f8b566f7b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:13.747813 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-26f1b627-628b-472c-a17a-8416f7eb02c3 req-9b425abe-8b69-47e0-b75b-8f9f8b566f7b service nova] Creating event network-vif-plugged:2192815c-21e5-45b9-9276-0015b17f5100 for instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 on hv-cinder-maste Apr 01 10:11:13.754006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-26f1b627-628b-472c-a17a-8416f7eb02c3 req-9b425abe-8b69-47e0-b75b-8f9f8b566f7b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033916 Apr 01 10:11:13.754891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 326/645] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:13.975983 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:13.977620 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:13.984489 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:13.985170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:13.986250 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:13.986530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:14.125734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:14.133244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1e42b794-908f-4d59-bbbe-24c8305d1412 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1363 microversion: 2.1 time: 0.163972 Apr 01 10:11:14.133810 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 320/646] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:13 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:15.153508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:15.154414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:15.160885 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:15.161333 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:15.162124 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:15.162592 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:15.301208 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:15.309117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5becec4e-d462-4a66-ae52-14b3a9b8c3ba tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1363 microversion: 2.1 time: 0.162083 Apr 01 10:11:15.309826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 327/647] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:15 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:11:16.328510 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:16.329224 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:16.336637 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:16.337234 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:16.338155 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:16.338826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:16.481065 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:16.488937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7be9817d-7ebb-47bf-a946-8892de69fe92 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1549 microversion: 2.1 time: 0.165228 Apr 01 10:11:16.489775 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 321/648] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:16 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1549 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:16.505566 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-68d2156b-a36d-4854-b9a4-366e8525330d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:16.506109 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-68d2156b-a36d-4854-b9a4-366e8525330d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:16.512392 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68d2156b-a36d-4854-b9a4-366e8525330d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:16.512844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68d2156b-a36d-4854-b9a4-366e8525330d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:16.513984 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68d2156b-a36d-4854-b9a4-366e8525330d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:16.514418 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68d2156b-a36d-4854-b9a4-366e8525330d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:16.600111 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-68d2156b-a36d-4854-b9a4-366e8525330d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098334 Apr 01 10:11:16.600887 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 328/649] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:11:16 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:16.643601 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-638763313"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:16.644324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:16.650540 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:16.650981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:16.652090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:16.652687 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:16.798753 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.network.security_group_api [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Removing security group 20177396-2571-4f5b-bfa6-d0d00e6adc2f from port 16f31c6b-b8cc-44ef-b38c-0325cd60edfc Apr 01 10:11:17.184199 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0923ca2f-cb38-4f5e-b598-339969372c60 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/action" status: 202 len: 0 microversion: 2.1 time: 0.549285 Apr 01 10:11:17.185103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 322/650] 10.222.0.46 () {60 vars in 1277 bytes} [Fri Apr 1 10:11:16 2022] POST /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/action => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:11:17.201250 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-f02b2c76-0f42-49e2-ac29-391b487443bc req-f9a51aff-5eb4-4cf7-8c24-c119539cb31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796459f-876f-4f0b-b0b1-aa45dbf9fabe", "tag": "16f31c6b-b8cc-44ef-b38c-0325cd60edfc"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:17.216921 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-f02b2c76-0f42-49e2-ac29-391b487443bc req-f9a51aff-5eb4-4cf7-8c24-c119539cb31f service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:17.220183 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-f02b2c76-0f42-49e2-ac29-391b487443bc req-f9a51aff-5eb4-4cf7-8c24-c119539cb31f service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:17.252387 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-f02b2c76-0f42-49e2-ac29-391b487443bc req-f9a51aff-5eb4-4cf7-8c24-c119539cb31f service nova] Creating event network-changed:16f31c6b-b8cc-44ef-b38c-0325cd60edfc for instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe on hv-cinder-maste Apr 01 10:11:17.265151 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-f02b2c76-0f42-49e2-ac29-391b487443bc req-f9a51aff-5eb4-4cf7-8c24-c119539cb31f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067344 Apr 01 10:11:17.267728 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 329/651] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:17.835822 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-2503c148-0664-4b07-9fcf-349e126826ec req-4b310ee5-320f-494c-b34c-37d753ee5d53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "857c3a0e-4b47-48d0-a1a6-fe530160b9b9", "tag": "2192815c-21e5-45b9-9276-0015b17f5100"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:17.845097 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-2503c148-0664-4b07-9fcf-349e126826ec req-4b310ee5-320f-494c-b34c-37d753ee5d53 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:17.845537 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-2503c148-0664-4b07-9fcf-349e126826ec req-4b310ee5-320f-494c-b34c-37d753ee5d53 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:17.857244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-2503c148-0664-4b07-9fcf-349e126826ec req-4b310ee5-320f-494c-b34c-37d753ee5d53 service nova] Creating event network-changed:2192815c-21e5-45b9-9276-0015b17f5100 for instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 on hv-cinder-maste Apr 01 10:11:17.862393 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-2503c148-0664-4b07-9fcf-349e126826ec req-4b310ee5-320f-494c-b34c-37d753ee5d53 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030226 Apr 01 10:11:17.863007 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 323/652] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:18.997997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:18.999449 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:19.006760 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:19.007231 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:19.008222 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:19.008661 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:19.096076 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.objects.instance [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lazy-loading 'services' on Instance uuid 3796459f-876f-4f0b-b0b1-aa45dbf9fabe {{(pid=117066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:11:19.249380 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-22199fb8-7fa1-4b55-ac00-3a3b106f93f8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments/79903a34-6a75-479f-b375-95d40f9fe01d" status: 202 len: 0 microversion: 2.1 time: 0.255382 Apr 01 10:11:19.251230 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 330/653] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:11:18 2022] DELETE /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments/79903a34-6a75-479f-b375-95d40f9fe01d => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:11:19.259794 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0c83e038-a19b-4b86-858b-24bc5b135f31 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:19.260869 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0c83e038-a19b-4b86-858b-24bc5b135f31 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:19.271181 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c83e038-a19b-4b86-858b-24bc5b135f31 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:19.272013 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c83e038-a19b-4b86-858b-24bc5b135f31 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:19.272987 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c83e038-a19b-4b86-858b-24bc5b135f31 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:19.273575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c83e038-a19b-4b86-858b-24bc5b135f31 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:19.300925 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-1d31497d-6443-4ea1-90ee-c2432434fc36 req-4fc9219e-ceec-438a-8b5d-1df4a30ebf51 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3796459f-876f-4f0b-b0b1-aa45dbf9fabe", "tag": "16f31c6b-b8cc-44ef-b38c-0325cd60edfc"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:19.313385 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-1d31497d-6443-4ea1-90ee-c2432434fc36 req-4fc9219e-ceec-438a-8b5d-1df4a30ebf51 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:19.314033 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-1d31497d-6443-4ea1-90ee-c2432434fc36 req-4fc9219e-ceec-438a-8b5d-1df4a30ebf51 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:19.315211 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0c83e038-a19b-4b86-858b-24bc5b135f31 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060195 Apr 01 10:11:19.320233 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 324/654] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:11:19 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:19.331655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-1d31497d-6443-4ea1-90ee-c2432434fc36 req-4fc9219e-ceec-438a-8b5d-1df4a30ebf51 service nova] Creating event network-changed:16f31c6b-b8cc-44ef-b38c-0325cd60edfc for instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe on hv-cinder-maste Apr 01 10:11:19.338510 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-1d31497d-6443-4ea1-90ee-c2432434fc36 req-4fc9219e-ceec-438a-8b5d-1df4a30ebf51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041498 Apr 01 10:11:19.339812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 331/655] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:20.327008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-32144e5f-1f51-4618-92e3-89d57f73f300 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:20.328086 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-32144e5f-1f51-4618-92e3-89d57f73f300 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:20.334529 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-32144e5f-1f51-4618-92e3-89d57f73f300 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:20.335020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-32144e5f-1f51-4618-92e3-89d57f73f300 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:20.335798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-32144e5f-1f51-4618-92e3-89d57f73f300 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:20.336222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-32144e5f-1f51-4618-92e3-89d57f73f300 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:20.365344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-32144e5f-1f51-4618-92e3-89d57f73f300 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042671 Apr 01 10:11:20.365843 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 325/656] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:11:20 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:11:20.377339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:20.377851 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:20.384152 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:20.384610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:20.385394 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:20.385879 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:20.467607 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] HTTP exception thrown: Instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe is not attached to volume 79903a34-6a75-479f-b375-95d40f9fe01d Apr 01 10:11:20.471328 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Returning 404 to user: Instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe is not attached to volume 79903a34-6a75-479f-b375-95d40f9fe01d {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:11:20.472400 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b8ffd36a-139b-4ec1-b233-db1e23cde1e0 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments/79903a34-6a75-479f-b375-95d40f9fe01d" status: 404 len: 154 microversion: 2.1 time: 0.099994 Apr 01 10:11:20.473508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 332/657] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:11:20 2022] DELETE /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe/os-volume_attachments/79903a34-6a75-479f-b375-95d40f9fe01d => generated 154 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:21.617257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:21.617846 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:21.624300 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:21.624694 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:21.625564 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:21.625993 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:21.650385 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:11:21.738449 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-28dce259-1f2a-4715-a3b5-1ea35b689ec3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "DELETE /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 204 len: 0 microversion: 2.1 time: 0.124664 Apr 01 10:11:21.739353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 326/658] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:11:21 2022] DELETE /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:11:21.747514 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:21.748133 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:21.754912 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:21.755634 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:21.756711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:21.757157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:21.894350 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:21.901663 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-41a504f3-0c7a-4efc-9326-6a15be138af3 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1554 microversion: 2.1 time: 0.158097 Apr 01 10:11:21.902232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 333/659] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:21 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:22.920296 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:22.921108 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:22.927785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:22.928244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:22.929022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:22.929651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:23.066036 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:23.073658 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-29483118-92b6-498b-8916-e85d9b63cb70 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1554 microversion: 2.1 time: 0.157759 Apr 01 10:11:23.074243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 327/660] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:22 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1554 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:11:24.092327 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:24.093078 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:24.099536 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:24.100066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:24.101060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:24.101508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:24.395310 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '865b26ccfed74865b856e8c3d33e3574', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4a61874308747efa6cf0456be5f46b6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:24.405517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fc5ff77c-0fb5-4606-9ed8-42f4bc68bd9e tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 200 len: 1554 microversion: 2.1 time: 0.318238 Apr 01 10:11:24.406098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 334/661] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:24 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 1554 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:24.612317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-7d49290d-8fa3-4863-8860-22c8feb0c70a req-38d4f9cb-e9d0-42ff-9114-9c47d192a757 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3796459f-876f-4f0b-b0b1-aa45dbf9fabe", "name": "network-vif-deleted", "tag": "16f31c6b-b8cc-44ef-b38c-0325cd60edfc"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:24.624469 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-7d49290d-8fa3-4863-8860-22c8feb0c70a req-38d4f9cb-e9d0-42ff-9114-9c47d192a757 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:24.625051 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-7d49290d-8fa3-4863-8860-22c8feb0c70a req-38d4f9cb-e9d0-42ff-9114-9c47d192a757 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:24.637276 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-7d49290d-8fa3-4863-8860-22c8feb0c70a req-38d4f9cb-e9d0-42ff-9114-9c47d192a757 service nova] Creating event network-vif-deleted:16f31c6b-b8cc-44ef-b38c-0325cd60edfc for instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe on hv-cinder-maste Apr 01 10:11:24.643121 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-7d49290d-8fa3-4863-8860-22c8feb0c70a req-38d4f9cb-e9d0-42ff-9114-9c47d192a757 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043166 Apr 01 10:11:24.643608 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 328/662] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:25.422507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:25.423119 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] [instance: 3796459f-876f-4f0b-b0b1-aa45dbf9fabe] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:25.429824 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:25.430275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:25.431157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:25.431530 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:25.445108 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] HTTP exception thrown: Instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe could not be found. Apr 01 10:11:25.445704 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Returning 404 to user: Instance 3796459f-876f-4f0b-b0b1-aa45dbf9fabe could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:11:25.446589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-baa89538-b468-45a4-920c-b162dd2476a8 tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe" status: 404 len: 111 microversion: 2.1 time: 0.027932 Apr 01 10:11:25.447139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 335/663] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:25 2022] GET /compute/v2.1/servers/3796459f-876f-4f0b-b0b1-aa45dbf9fabe => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:25.456151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3d9a3a15-7fb4-43a2-963a-7cebaf22869d tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] Calling method '.version_select at 0x7f64ed8e69d0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:25.475816 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3d9a3a15-7fb4-43a2-963a-7cebaf22869d tempest-TestMinimumBasicScenario-1271455794 tempest-TestMinimumBasicScenario-1271455794-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-650435568" status: 202 len: 0 microversion: 2.1 time: 0.023766 Apr 01 10:11:25.476406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 329/664] 10.222.0.46 () {58 vars in 1268 bytes} [Fri Apr 1 10:11:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-650435568 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:11:26.742374 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-433388074", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:26.796422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] validate_networks() for None {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:11:27.373194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:11:27.373614 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:11:27.374081 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:11:27.374486 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:11:27.374894 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:11:27.384079 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:27.384556 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:27.385352 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:27.385777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:27.402976 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Getting quotas for project 6374d011e9ad490ca38ae0fd039cd183. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:11:27.407217 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Getting quotas for user a22c2aa1290b4e808af57f2496303c48 and project 6374d011e9ad490ca38ae0fd039cd183. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:11:27.419834 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:11:27.422158 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:11:27.475741 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8714aa34-6941-4996-8196-38b611f307e2 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.737111 Apr 01 10:11:27.476679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 336/665] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:11:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 739 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:11:27.487910 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8d1eb521-d1d8-4748-93f3-06754104c3f7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:27.489460 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8d1eb521-d1d8-4748-93f3-06754104c3f7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:27.548045 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d1eb521-d1d8-4748-93f3-06754104c3f7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:27.556507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8d1eb521-d1d8-4748-93f3-06754104c3f7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1214 microversion: 2.1 time: 0.073230 Apr 01 10:11:27.557175 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 330/666] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:27 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1214 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:28.576603 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:28.577495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:28.588239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:28.588970 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:28.590060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:28.590852 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:28.697502 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:28.705667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e3dc9b8f-0d04-4d78-baee-d3b6d75fea92 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1272 microversion: 2.1 time: 0.135976 Apr 01 10:11:28.706225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 337/667] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:28 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1272 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:29.723474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:29.724090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:29.738143 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:29.742781 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:29.744511 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:29.745538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:30.006107 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:30.017624 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-564731aa-488e-4901-b095-5f0a3da2e4c3 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.298368 Apr 01 10:11:30.019839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 331/668] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:29 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:30.598588 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-c96c7d38-624e-431c-9d39-653f3c2e270c req-295be789-6957-4f0e-af7d-db2387a37cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c75d4c4-55de-4786-bc0e-e8079dcc6067", "tag": "517184a0-b6b3-48c0-88f0-46977baba52b"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:30.609957 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-c96c7d38-624e-431c-9d39-653f3c2e270c req-295be789-6957-4f0e-af7d-db2387a37cef service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:30.616177 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-c96c7d38-624e-431c-9d39-653f3c2e270c req-295be789-6957-4f0e-af7d-db2387a37cef service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:30.641876 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-c96c7d38-624e-431c-9d39-653f3c2e270c req-295be789-6957-4f0e-af7d-db2387a37cef service nova] Creating event network-changed:517184a0-b6b3-48c0-88f0-46977baba52b for instance 5c75d4c4-55de-4786-bc0e-e8079dcc6067 on hv-cinder-maste Apr 01 10:11:30.648602 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-c96c7d38-624e-431c-9d39-653f3c2e270c req-295be789-6957-4f0e-af7d-db2387a37cef service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060330 Apr 01 10:11:30.650733 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 338/669] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:31.035592 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:31.036183 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:31.042698 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:31.043172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:31.043902 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:31.044353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:31.180885 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:31.188502 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-23d445d7-e461-43ca-892f-295cfb976fda tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.156785 Apr 01 10:11:31.189098 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 332/670] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:31 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:32.206953 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:32.208289 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:32.215554 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:32.216178 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:32.217194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:32.217715 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:32.520363 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:32.527685 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-71940798-7ef6-4bbe-a37f-6bb51f443d50 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.325792 Apr 01 10:11:32.528353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 339/671] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:32 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:33.544696 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:33.545360 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:33.551913 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:33.552472 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:33.553256 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:33.553686 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:33.687981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:33.696492 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6fc48dbe-a4e8-49b7-af53-27e2a7f16bd1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.155549 Apr 01 10:11:33.697014 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 333/672] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:33 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:34.715145 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:34.716390 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:34.728044 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:34.728762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:34.729746 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:34.730251 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:34.873561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:34.880928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c1c91ad8-f15e-443d-9c62-9d8d3aaa05a1 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.171094 Apr 01 10:11:34.881495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 340/673] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:34 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:35.898528 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:35.899169 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:35.906326 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:35.906798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:35.907719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:35.908147 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:36.048814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:36.056354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d729b050-49fa-436d-9306-c96fb98df1c7 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.162011 Apr 01 10:11:36.056943 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 334/674] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:35 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:37.082637 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:37.083657 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:37.094591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:37.095459 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:37.096239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:37.096676 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:37.235962 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:37.244103 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d4bbc380-3d5a-41d5-96cf-022067a63dec tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.168022 Apr 01 10:11:37.244687 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 341/675] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:37 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:37.778665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-bc024640-a883-42a1-b0c2-b86ff2573c24 req-28d27354-7310-48de-a706-50c7e1f9d6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c75d4c4-55de-4786-bc0e-e8079dcc6067", "name": "network-vif-plugged", "status": "completed", "tag": "517184a0-b6b3-48c0-88f0-46977baba52b"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:37.788210 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-bc024640-a883-42a1-b0c2-b86ff2573c24 req-28d27354-7310-48de-a706-50c7e1f9d6d3 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:37.788633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-bc024640-a883-42a1-b0c2-b86ff2573c24 req-28d27354-7310-48de-a706-50c7e1f9d6d3 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:37.801507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-bc024640-a883-42a1-b0c2-b86ff2573c24 req-28d27354-7310-48de-a706-50c7e1f9d6d3 service nova] Creating event network-vif-plugged:517184a0-b6b3-48c0-88f0-46977baba52b for instance 5c75d4c4-55de-4786-bc0e-e8079dcc6067 on hv-cinder-maste Apr 01 10:11:37.806522 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-bc024640-a883-42a1-b0c2-b86ff2573c24 req-28d27354-7310-48de-a706-50c7e1f9d6d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031720 Apr 01 10:11:37.807391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 335/676] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:38.265829 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:38.266751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:38.274138 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:38.274683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:38.275515 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:38.275970 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:38.416202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:38.424447 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7b4789e4-9b4d-4a50-8ec5-5ed32c7fae8b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.165627 Apr 01 10:11:38.425007 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 342/677] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:38 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:39.444974 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:39.445853 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:39.454514 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:39.455855 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:39.457046 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:39.457608 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:39.596850 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:39.604394 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-01e6b77d-fe2a-47da-9092-a7f733e566ac tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1314 microversion: 2.1 time: 0.165117 Apr 01 10:11:39.604989 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 336/678] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:39 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:40.625628 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:40.626713 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:40.637947 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:40.638791 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:40.640072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:40.640799 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:40.774242 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:40.781739 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1b9e6bac-6030-402f-a1c3-95364b5c1c4c tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1464 microversion: 2.1 time: 0.162754 Apr 01 10:11:40.782341 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 343/679] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:40 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1464 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:40.822035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:40.822703 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:40.831332 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:40.831785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:40.832530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:40.832960 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:40.857720 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:11:40.942911 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-065a1a78-9c5a-4fda-b002-a363d76e0452 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 204 len: 0 microversion: 2.1 time: 0.126690 Apr 01 10:11:40.946839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 337/680] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:11:40 2022] DELETE /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:11:40.952739 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:40.953471 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:40.959637 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:40.960113 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:40.960891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:40.961317 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:41.100010 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:41.112166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7e35ebbb-2b3e-4d09-8c6e-ead88a67698b tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1470 microversion: 2.1 time: 0.163524 Apr 01 10:11:41.113089 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 344/681] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:40 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1470 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:42.141112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:42.142242 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:42.149666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:42.150138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:42.150974 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:42.151423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:42.453569 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:42.461409 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-824f1d19-add8-43e2-9ff8-1386e216ab38 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1470 microversion: 2.1 time: 0.327832 Apr 01 10:11:42.461977 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 338/682] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:42 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1470 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:43.127578 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-cbde76c2-e379-4b9f-9d54-02a1f9aa90e4 req-a0e458cb-27b0-43ae-8207-2c43ff109f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c75d4c4-55de-4786-bc0e-e8079dcc6067", "name": "network-vif-deleted", "tag": "517184a0-b6b3-48c0-88f0-46977baba52b"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:43.136267 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-cbde76c2-e379-4b9f-9d54-02a1f9aa90e4 req-a0e458cb-27b0-43ae-8207-2c43ff109f52 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:43.136804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-cbde76c2-e379-4b9f-9d54-02a1f9aa90e4 req-a0e458cb-27b0-43ae-8207-2c43ff109f52 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:43.149265 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-cbde76c2-e379-4b9f-9d54-02a1f9aa90e4 req-a0e458cb-27b0-43ae-8207-2c43ff109f52 service nova] Creating event network-vif-deleted:517184a0-b6b3-48c0-88f0-46977baba52b for instance 5c75d4c4-55de-4786-bc0e-e8079dcc6067 on hv-cinder-maste Apr 01 10:11:43.154976 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-cbde76c2-e379-4b9f-9d54-02a1f9aa90e4 req-a0e458cb-27b0-43ae-8207-2c43ff109f52 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031031 Apr 01 10:11:43.155769 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 345/683] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:11:43.482734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:43.484763 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:43.492265 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:43.492719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:43.494029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:43.494029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:43.525816 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:43.526377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:43.526857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lazy-loading 'fault' on Instance uuid 5c75d4c4-55de-4786-bc0e-e8079dcc6067 {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:11:43.568459 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a22c2aa1290b4e808af57f2496303c48', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6374d011e9ad490ca38ae0fd039cd183', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:43.576062 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-91ee7a8a-5c29-4071-8668-ff5adcb200c5 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 200 len: 1304 microversion: 2.1 time: 0.099698 Apr 01 10:11:43.576879 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 339/684] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:43 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:44.593715 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:44.594407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] [instance: 5c75d4c4-55de-4786-bc0e-e8079dcc6067] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:44.601092 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:44.601546 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:44.602310 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:44.602776 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:44.615642 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] HTTP exception thrown: Instance 5c75d4c4-55de-4786-bc0e-e8079dcc6067 could not be found. Apr 01 10:11:44.616215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] Returning 404 to user: Instance 5c75d4c4-55de-4786-bc0e-e8079dcc6067 could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:11:44.617018 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d65773c4-1f77-429e-a3e7-771eb7dae101 tempest-VolumesNegativeTest-204165607 tempest-VolumesNegativeTest-204165607-project] 10.222.0.46 "GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067" status: 404 len: 111 microversion: 2.1 time: 0.028149 Apr 01 10:11:44.617762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 346/685] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:44 2022] GET /compute/v2.1/servers/5c75d4c4-55de-4786-bc0e-e8079dcc6067 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:11:51.761020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1953927460", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "networks": [{"uuid": "7bfcac4a-d60e-4922-b594-c3472a473d4a"}]}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:51.812738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] validate_networks() for [('7bfcac4a-d60e-4922-b594-c3472a473d4a', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:11:52.170109 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:11:52.170535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:11:52.171038 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:11:52.171453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:11:52.171845 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:11:52.181454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:52.181928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:52.182758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:52.183193 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:52.201034 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Getting quotas for project bbdc40573f43486bb7c7a2fc5f262033. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:11:52.205365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Getting quotas for user ac87a6bd2eef40c58f71e7a787e18651 and project bbdc40573f43486bb7c7a2fc5f262033. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:11:52.217324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:11:52.219576 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:11:52.269269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-796f958f-e7e3-442a-a34c-94eb7fe34e91 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512242 Apr 01 10:11:52.269891 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 340/686] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:11:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 513 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:11:52.280072 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c4258866-1341-4b74-a5ff-c9ea21ffd88e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:52.281844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c4258866-1341-4b74-a5ff-c9ea21ffd88e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:52.335964 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c4258866-1341-4b74-a5ff-c9ea21ffd88e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:52.343133 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c4258866-1341-4b74-a5ff-c9ea21ffd88e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1219 microversion: 2.1 time: 0.066897 Apr 01 10:11:52.343712 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 347/687] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:52 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:53.361440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:53.362066 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:53.369975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:53.370476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:53.372121 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:53.372121 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:53.433284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:53.441117 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2229b4c3-0487-4388-9f4a-f2b183b235f9 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1277 microversion: 2.1 time: 0.084359 Apr 01 10:11:53.441674 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 341/688] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:53 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:54.458447 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:54.459060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:54.467210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:54.467210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:54.468017 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:54.468661 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:54.554711 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-9e2ac2fc-b9a9-45f4-81b6-c083268f1244 req-a9d138a7-689e-403f-83e0-c27d694894db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0f3070bf-3c0e-4e79-8129-264ad5e17aa1", "tag": "991d8877-8dfb-4a18-9b25-395c5933b64f"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:54.565617 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-9e2ac2fc-b9a9-45f4-81b6-c083268f1244 req-a9d138a7-689e-403f-83e0-c27d694894db service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:54.566382 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-9e2ac2fc-b9a9-45f4-81b6-c083268f1244 req-a9d138a7-689e-403f-83e0-c27d694894db service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:54.578700 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-9e2ac2fc-b9a9-45f4-81b6-c083268f1244 req-a9d138a7-689e-403f-83e0-c27d694894db service nova] Creating event network-changed:991d8877-8dfb-4a18-9b25-395c5933b64f for instance 0f3070bf-3c0e-4e79-8129-264ad5e17aa1 on hv-cinder-maste Apr 01 10:11:54.583710 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-9e2ac2fc-b9a9-45f4-81b6-c083268f1244 req-a9d138a7-689e-403f-83e0-c27d694894db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032827 Apr 01 10:11:54.584307 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 342/689] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:11:54.720993 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:54.729327 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6f15be2a-ad0d-4b19-9fe9-259bd7d629fc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1319 microversion: 2.1 time: 0.274797 Apr 01 10:11:54.729910 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 348/690] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:54 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1319 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:55.752659 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:55.753657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:55.762817 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:55.763272 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:55.764051 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:55.764514 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:55.910751 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:55.919555 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-469d18c0-9f65-4fe6-854c-7c5d2688742b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1319 microversion: 2.1 time: 0.174943 Apr 01 10:11:55.920218 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 343/691] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:55 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:56.940848 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:56.941909 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:56.952598 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:56.953351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:56.954628 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:56.955398 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:57.102681 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:57.110591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b05ace0a-a49f-4c8e-864b-f36b0b4cb40e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1319 microversion: 2.1 time: 0.176411 Apr 01 10:11:57.111351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 349/692] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:56 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:58.132611 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:58.133628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:58.143136 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:58.143791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:58.144958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:58.145422 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:58.285026 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:58.293024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f917681d-1c1a-412c-b104-badb8b80a5ab tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1319 microversion: 2.1 time: 0.167331 Apr 01 10:11:58.293596 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 344/693] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:58 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:59.311077 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:11:59.311683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:11:59.319552 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:59.319996 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:59.321738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:59.322171 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:59.464637 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:11:59.472911 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-aee340cd-c54f-4742-89a9-bb38af53d279 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1319 microversion: 2.1 time: 0.165826 Apr 01 10:11:59.473600 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 350/694] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:11:59 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:11:59.893183 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-09c7a429-9e37-4060-9b19-b1cf19b1ce92 req-8a8d67e4-b6a8-4eac-bb10-9f014a4e0692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3070bf-3c0e-4e79-8129-264ad5e17aa1", "name": "network-vif-plugged", "status": "completed", "tag": "991d8877-8dfb-4a18-9b25-395c5933b64f"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:11:59.902305 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-09c7a429-9e37-4060-9b19-b1cf19b1ce92 req-8a8d67e4-b6a8-4eac-bb10-9f014a4e0692 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:11:59.902898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-09c7a429-9e37-4060-9b19-b1cf19b1ce92 req-8a8d67e4-b6a8-4eac-bb10-9f014a4e0692 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:11:59.916636 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-09c7a429-9e37-4060-9b19-b1cf19b1ce92 req-8a8d67e4-b6a8-4eac-bb10-9f014a4e0692 service nova] Creating event network-vif-plugged:991d8877-8dfb-4a18-9b25-395c5933b64f for instance 0f3070bf-3c0e-4e79-8129-264ad5e17aa1 on hv-cinder-maste Apr 01 10:11:59.921585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-09c7a429-9e37-4060-9b19-b1cf19b1ce92 req-8a8d67e4-b6a8-4eac-bb10-9f014a4e0692 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 Apr 01 10:11:59.922177 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 345/695] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:11:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:12:00.495979 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:00.496910 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:00.507595 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:00.508332 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:00.509674 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:00.510102 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:00.660771 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:00.671481 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-94b302a7-582a-46ab-812d-8e7917ace441 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1319 microversion: 2.1 time: 0.181862 Apr 01 10:12:00.672190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 351/696] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:00 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1319 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:01.702685 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:01.703828 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:01.714536 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:01.715344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:01.716628 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:01.717344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:01.874944 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:01.883042 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bf0412bf-5357-4912-b26a-f141e461f2c8 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1507 microversion: 2.1 time: 0.188483 Apr 01 10:12:01.883581 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 346/697] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:01 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:05.898524 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-11c685a6-e2bd-4215-9e11-18f752ecec0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:05.899188 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-11c685a6-e2bd-4215-9e11-18f752ecec0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:05.905647 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11c685a6-e2bd-4215-9e11-18f752ecec0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:05.906099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11c685a6-e2bd-4215-9e11-18f752ecec0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:05.906914 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11c685a6-e2bd-4215-9e11-18f752ecec0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:05.907354 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-11c685a6-e2bd-4215-9e11-18f752ecec0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:05.932439 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-11c685a6-e2bd-4215-9e11-18f752ecec0c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/ips" status: 200 len: 151 microversion: 2.20 time: 0.038347 Apr 01 10:12:05.933011 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 352/698] 10.222.0.46 () {60 vars in 1288 bytes} [Fri Apr 1 10:12:05 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:12:08.124879 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:08.125569 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:08.132329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:08.132785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:08.133573 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:08.134014 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:08.157606 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lazy-loading 'flavor' on Instance uuid 5b6b5d9e-6bee-443c-86e3-94e71c99643d {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:12:08.423831 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-899d3f1f-eab7-4771-b510-a263396797bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/action" status: 202 len: 0 microversion: 2.20 time: 0.302771 Apr 01 10:12:08.424361 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 347/699] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 1 10:12:08 2022] POST /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:12:08.434496 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:08.435565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:08.443076 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:08.443494 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:08.444299 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:08.444723 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:08.584816 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:08.593651 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:08.595271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:08.596483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8f76cc78-da1c-4c94-b1c5-9dce0b319dd0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.167665 Apr 01 10:12:08.597031 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 353/700] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:08 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:12:09.616958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:09.617624 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:09.624698 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:09.625151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:09.626047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:09.626532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:09.767582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:09.775913 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:09.777671 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:09.779089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-012cb6ff-b1bc-4031-b4bb-d8d908e227d5 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.167545 Apr 01 10:12:09.779863 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 348/701] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:09 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:10.797402 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:10.798002 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:10.804756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:10.805224 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:10.805984 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:10.806414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:10.962341 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:10.971277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:10.972943 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:10.974166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-49c3c7c4-7a72-4ccb-8d48-1c16f3fdb4a8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.180751 Apr 01 10:12:10.974789 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 354/702] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:10 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:11.996225 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:11.997274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:12.007867 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:12.008315 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:12.009096 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:12.009531 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:12.148381 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:12.156312 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:12.157792 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:12.159032 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-37eede1f-5e39-417e-a2d5-3d52598e6605 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.169370 Apr 01 10:12:12.159623 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 349/703] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:11 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:13.179219 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:13.179772 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:13.186559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:13.187043 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:13.187813 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:13.188246 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:13.327503 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:13.337128 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:13.338584 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:13.340199 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8749bf51-3c3f-4dc4-89ea-956ad7ac6d7e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.165307 Apr 01 10:12:13.341277 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 355/704] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:13 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:14.363024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:14.363841 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:14.374554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:14.375340 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:14.376627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:14.377299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:14.529282 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:14.541653 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:14.544108 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:14.545920 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ebd94e66-5681-40c2-ba00-689191a434fb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.188957 Apr 01 10:12:14.546631 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 350/705] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:14 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:15.569150 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:15.570080 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:15.577104 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:15.577535 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:15.578337 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:15.578814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:15.714015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:15.726026 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:15.727986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:15.729170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-48fb0819-06dc-426d-a4ea-f44dc15a6964 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.167018 Apr 01 10:12:15.729733 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 356/706] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:15 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:16.751665 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:16.752493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:16.763306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:16.764104 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:16.765364 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:16.766116 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:16.912238 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:16.920560 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:16.922056 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:16.923255 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bdd2adb7-cc8a-4c5f-a534-7f986ab9fdee tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.178552 Apr 01 10:12:16.923796 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 351/707] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:16 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:17.946501 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:17.947559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:17.958152 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:17.958956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:17.960212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:17.960923 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:18.105080 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:18.113429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:18.114950 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:18.116112 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-321c26bd-3be8-452a-adad-2afca2a5b71e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.176500 Apr 01 10:12:18.116696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 357/708] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:17 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:19.139226 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:19.140308 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:19.150262 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:19.150750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:19.151528 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:19.151963 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:19.290022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:19.298680 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:19.300205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:19.301374 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3ab9950f-793d-418f-972c-05e77b5b5adc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.169221 Apr 01 10:12:19.301947 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 352/709] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:19 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:20.324065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:20.324752 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:20.333105 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:20.333664 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:20.334619 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:20.335183 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:20.631585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:20.640128 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:20.641631 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:20.642839 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-05dabd9f-200d-4c1d-b16a-0411a97eec9f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.325784 Apr 01 10:12:20.643438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 358/710] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:20 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:21.665484 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:21.666280 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:21.675010 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:21.675603 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:21.676604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:21.677172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:21.822253 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:21.832521 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:21.833990 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:21.835203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5119f9d5-f2a5-42b0-939c-682ad9d65cb6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.176431 Apr 01 10:12:21.835758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 353/711] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:21 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:22.858046 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:22.858927 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:22.869621 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:22.870085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:22.870916 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:22.871340 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:23.021904 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:23.030081 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:23.031585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:23.032970 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-00b860a3-c51c-4877-9a7c-4a1c1b7785ed tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.181439 Apr 01 10:12:23.033507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 359/712] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:22 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:23.447151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8bb7a0a3-56d8-4a2d-8ddb-e0109fc68ea0 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb6f3199-a040-4c21-87fa-6023208d577f", "device": "/dev/sdb"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:23.449757 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8bb7a0a3-56d8-4a2d-8ddb-e0109fc68ea0 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:23.458236 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8bb7a0a3-56d8-4a2d-8ddb-e0109fc68ea0 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:23.458705 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8bb7a0a3-56d8-4a2d-8ddb-e0109fc68ea0 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:23.459493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8bb7a0a3-56d8-4a2d-8ddb-e0109fc68ea0 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:23.459929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8bb7a0a3-56d8-4a2d-8ddb-e0109fc68ea0 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:23.706889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8bb7a0a3-56d8-4a2d-8ddb-e0109fc68ea0 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "POST /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265941 Apr 01 10:12:23.707474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 354/713] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:12:23 2022] POST /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1/os-volume_attachments => generated 194 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:12:24.051656 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:24.052225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:24.059569 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:24.060015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:24.060844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:24.061511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:24.195209 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:24.203534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:24.205027 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:24.206230 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6a09ad32-b088-477c-ae5e-ae93dcae34ce tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.158673 Apr 01 10:12:24.206841 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 360/714] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:24 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:25.230107 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:25.231053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:25.238096 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:25.238546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:25.239360 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:25.239794 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:25.389341 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:25.401416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:25.403739 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:25.405511 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5931d306-172d-4b9f-ac6d-54e6fc33bd1c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.182461 Apr 01 10:12:25.406341 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 355/715] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:25 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:26.433206 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:26.434260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:26.442020 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:26.442525 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:26.443424 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:26.443904 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:26.583925 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:26.592496 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:26.593986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:26.595194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-86488a37-0744-48fc-a426-aaf5ae531fe6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.168692 Apr 01 10:12:26.595750 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 361/716] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:26 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:27.616882 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:27.617490 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:27.627058 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:27.627718 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:27.628727 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:27.629297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:27.767896 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:27.775843 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:27.777346 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:27.778493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1ffbfae0-b731-444e-92a1-919ac9eef67f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.167896 Apr 01 10:12:27.779087 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 356/717] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:27 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:28.055179 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-5a65dbb6-3284-4e76-9496-94aba6c84a55 req-26ff91d5-b8de-4b03-b803-8cecab5a56a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b5d9e-6bee-443c-86e3-94e71c99643d", "name": "network-vif-plugged", "status": "completed", "tag": "29223cc6-236b-47ca-8914-e65111046089"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:28.064444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5a65dbb6-3284-4e76-9496-94aba6c84a55 req-26ff91d5-b8de-4b03-b803-8cecab5a56a2 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:28.064865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-5a65dbb6-3284-4e76-9496-94aba6c84a55 req-26ff91d5-b8de-4b03-b803-8cecab5a56a2 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:28.075714 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-5a65dbb6-3284-4e76-9496-94aba6c84a55 req-26ff91d5-b8de-4b03-b803-8cecab5a56a2 service nova] Creating event network-vif-plugged:29223cc6-236b-47ca-8914-e65111046089 for instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d on hv-cinder-maste Apr 01 10:12:28.080690 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-5a65dbb6-3284-4e76-9496-94aba6c84a55 req-26ff91d5-b8de-4b03-b803-8cecab5a56a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029204 Apr 01 10:12:28.081304 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 362/718] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:12:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:12:28.806740 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:28.807585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:28.815010 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:28.815453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:28.816269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:28.816729 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:28.970438 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:28.978633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:28.980139 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:28.981329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6e629ca4-b309-4715-9e73-bd91097dd675 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.181290 Apr 01 10:12:28.981886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 357/719] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:28 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:30.013048 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:30.013782 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:30.020717 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:30.021220 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:30.022002 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:30.022440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:30.158591 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:30.170482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:30.172844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:30.174618 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d8666d17-d3bc-4055-9db4-cd472bc83763 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.169975 Apr 01 10:12:30.175382 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 363/720] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:30 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:31.195548 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:31.196114 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:31.202912 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:31.203362 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:31.204129 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:31.204538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:31.338910 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:31.347207 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:31.348693 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:31.349871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-53cd3cdb-6233-441a-9636-b42480c02172 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.158236 Apr 01 10:12:31.350437 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 358/721] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:31 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:32.368819 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:32.369413 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:32.376284 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:32.376748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:32.377520 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:32.377958 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:32.836334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:32.845557 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:32.847225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:32.848414 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3be745f4-ef07-40b9-bdd5-44b1cff57247 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.483691 Apr 01 10:12:32.849006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 364/722] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:32 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:33.315534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-703feb8f-9183-495d-8513-f47451d3d187 req-ecf082b4-b55f-4b7e-995e-c166f1c970bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "50585cb5-8edf-45ce-833d-3109010a299e", "tag": "8b587726-e35f-40ca-8c0d-3c4d86c794ce"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:33.319984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:33.320496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:33.324691 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-703feb8f-9183-495d-8513-f47451d3d187 req-ecf082b4-b55f-4b7e-995e-c166f1c970bd service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:33.325225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-703feb8f-9183-495d-8513-f47451d3d187 req-ecf082b4-b55f-4b7e-995e-c166f1c970bd service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:33.326958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:33.327406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:33.328173 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:33.328604 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:33.336901 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-703feb8f-9183-495d-8513-f47451d3d187 req-ecf082b4-b55f-4b7e-995e-c166f1c970bd service nova] Creating event network-changed:8b587726-e35f-40ca-8c0d-3c4d86c794ce for instance 50585cb5-8edf-45ce-833d-3109010a299e on hv-cinder-maste Apr 01 10:12:33.342283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-703feb8f-9183-495d-8513-f47451d3d187 req-ecf082b4-b55f-4b7e-995e-c166f1c970bd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030260 Apr 01 10:12:33.343118 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 365/723] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:12:33.354027 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:12:33.433621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8a9e9261-f0df-4ef9-9a28-0747a717c403 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "DELETE /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 204 len: 0 microversion: 2.1 time: 0.125242 Apr 01 10:12:33.434407 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 359/724] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:12:33 2022] DELETE /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:12:33.444609 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:33.445306 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:33.451909 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:33.452386 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:33.453333 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:33.453549 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:33.585261 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:33.592944 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-be75fe52-6428-4341-999f-552498ad5423 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.154056 Apr 01 10:12:33.593520 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 366/725] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:33 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:33.867624 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:33.868320 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:33.874614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:33.875134 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:33.875901 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:33.876335 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:34.014527 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:34.022427 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:34.023950 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:34.025089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e3830072-e7f1-40a0-9fb2-dab7778ac023 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.161851 Apr 01 10:12:34.025674 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 360/726] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:33 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:34.611391 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:34.611995 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:34.618686 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:34.619151 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:34.619923 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:34.620355 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:34.757915 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:34.766745 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d53eed59-3b83-4deb-be1b-e656bc4d0282 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.159294 Apr 01 10:12:34.767305 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 367/727] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:34 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:35.047306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:35.048244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:35.058835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:35.059615 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:35.060630 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:35.061064 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:35.209654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:35.218067 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:35.219598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:35.220767 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e3eb833a-cddb-41a9-80b0-e7f48f9870aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.180043 Apr 01 10:12:35.221331 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 361/728] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:35 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:35.788289 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:35.789274 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:35.799973 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:35.800719 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:35.802004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:35.802729 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:35.972942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:35.982524 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9edb4887-d1c0-4b2e-86b0-cc935f39061f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1569 microversion: 2.1 time: 0.200901 Apr 01 10:12:35.983351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 368/729] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:35 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:36.238431 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:36.239138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:36.245605 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:36.246127 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:36.247025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:36.247483 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:36.383233 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:36.391890 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:36.394256 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:36.395513 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e81ae6f8-6adb-4ba5-9b33-b468a1c426b0 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1744 microversion: 2.20 time: 0.160991 Apr 01 10:12:36.396221 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 362/730] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:36 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:12:37.004679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:37.005417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:37.012280 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:37.012866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:37.013738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:37.014252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:37.151136 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:37.159350 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2811b212-191e-4e1e-a33c-86e04f4f05c8 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1450 microversion: 2.1 time: 0.158523 Apr 01 10:12:37.159914 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 369/731] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:36 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1450 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:37.413858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:37.415121 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:37.421989 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:37.422505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:37.423364 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:37.423857 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:37.568992 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:37.577362 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:37.578964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:37.580406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c2eb5ffe-9d72-423a-ae5c-409fabd6af49 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.170618 Apr 01 10:12:37.581312 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 363/732] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:37 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:38.177429 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:38.178067 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:38.184262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:38.184803 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:38.185577 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:38.186005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:38.336290 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:38.344339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-54d02dbf-d20d-421d-8ed8-b033b11f72c4 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1450 microversion: 2.1 time: 0.171511 Apr 01 10:12:38.344916 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 370/733] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:38 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1450 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:38.600535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:38.601428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:38.617048 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:38.618899 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:38.620241 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:38.620466 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:38.760730 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:38.772962 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:38.774491 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:38.775729 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-294f3a4c-129b-4b8f-83a3-4f7dbce372ac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.180143 Apr 01 10:12:38.781945 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 364/734] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:38 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:39.360904 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:39.362170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:39.368494 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:39.369222 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:39.370219 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:39.370778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:39.528516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:39.537433 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f7957bc8-1e92-4e56-aed1-73be625d7166 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1450 microversion: 2.1 time: 0.180388 Apr 01 10:12:39.538021 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 371/735] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:39 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1450 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:39.800597 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:39.801305 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:39.807491 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:39.807929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:39.808717 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:39.809144 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:39.958839 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:39.970887 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:39.972539 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:39.973707 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ff7cb3a1-1ba0-41ea-bd73-6b7dddf537aa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.177832 Apr 01 10:12:39.974275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 365/736] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:39 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:40.554796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:40.555630 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:40.562417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:40.562984 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:40.564016 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:40.564523 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:40.711397 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:40.719185 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-702e8737-e346-40a2-a3bd-eea7442aa00f tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1450 microversion: 2.1 time: 0.168478 Apr 01 10:12:40.719894 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 372/737] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:40 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1450 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:40.991972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:40.993436 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:40.999928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:41.000474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:41.001465 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:41.002082 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:41.168659 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:41.178247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:41.179882 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:41.181175 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6e46378d-86fd-4d0b-9e9e-eb1d398987b6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.193150 Apr 01 10:12:41.181817 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 366/738] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:40 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:41.736776 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:41.738405 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:41.746187 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:41.747438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:41.748898 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:41.749538 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:41.911935 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:41.920067 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4f41e727-77b3-49ec-b981-f0e0ff06e016 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1450 microversion: 2.1 time: 0.187976 Apr 01 10:12:41.920667 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 373/739] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:41 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1450 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:42.201771 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:42.203088 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:42.210900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:42.211727 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:42.212730 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:42.213261 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:42.383838 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:42.398632 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:42.401161 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:42.402582 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-fbd2abde-7c2b-48e3-94cc-d05300c7337f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.205251 Apr 01 10:12:42.403236 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 367/740] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:42 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:12:42.591702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-b50b291b-9390-435b-8b37-c7b480f864f5 req-759002b1-eca0-47e1-824a-c727ece41506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "50585cb5-8edf-45ce-833d-3109010a299e", "name": "network-vif-deleted", "tag": "8b587726-e35f-40ca-8c0d-3c4d86c794ce"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:42.601482 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-b50b291b-9390-435b-8b37-c7b480f864f5 req-759002b1-eca0-47e1-824a-c727ece41506 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:42.602190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-b50b291b-9390-435b-8b37-c7b480f864f5 req-759002b1-eca0-47e1-824a-c727ece41506 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:42.613555 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-b50b291b-9390-435b-8b37-c7b480f864f5 req-759002b1-eca0-47e1-824a-c727ece41506 service nova] Creating event network-vif-deleted:8b587726-e35f-40ca-8c0d-3c4d86c794ce for instance 50585cb5-8edf-45ce-833d-3109010a299e on hv-cinder-maste Apr 01 10:12:42.618995 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-b50b291b-9390-435b-8b37-c7b480f864f5 req-759002b1-eca0-47e1-824a-c727ece41506 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031254 Apr 01 10:12:42.619969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 374/741] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:12:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:12:42.937415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:42.938025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:42.949816 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:42.950264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:42.951153 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:42.951731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:43.025323 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:43.035909 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8193c410-ab11-4812-94fa-1a656aacd900 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1382 microversion: 2.1 time: 0.102464 Apr 01 10:12:43.048068 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 368/742] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:42 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1382 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:43.423640 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:43.425942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:43.433784 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:43.434664 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:43.435936 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:43.436434 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:43.584920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:43.593712 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:43.595306 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:43.596519 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-33b2718e-ff0e-4e3f-a104-7d103b666b33 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.178583 Apr 01 10:12:43.597085 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 375/743] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:43 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:44.053856 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:44.054508 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:44.062768 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:44.063534 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:44.064996 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:44.065595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:44.164326 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:44.172400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-fdab583b-efc9-4ac6-9218-fcf3e10550c6 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1382 microversion: 2.1 time: 0.122331 Apr 01 10:12:44.173184 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 369/744] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:44 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1382 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:44.614356 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:44.615136 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:44.621911 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:44.622361 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:44.623140 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:44.623765 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:44.762210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:44.770748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:44.772343 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:44.773702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1fe0496f-81c7-423b-ad33-af2f36be6e17 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.163193 Apr 01 10:12:44.774423 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 376/745] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:44 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:45.189510 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:45.191414 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:45.198557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:45.199505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:45.200388 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:45.200827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:45.269792 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:45.277998 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-dac970e4-5d92-4f62-8f80-c501a9178476 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1219 microversion: 2.1 time: 0.092254 Apr 01 10:12:45.278598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 370/746] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:45 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:12:45.792808 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:45.793450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:45.807026 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:45.807660 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:45.808763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:45.809686 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:45.959726 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:45.967610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:45.969109 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:45.970286 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6f875f03-fa84-4bda-a1f4-73116edd446d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.181665 Apr 01 10:12:45.981369 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 377/747] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:45 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:12:46.298447 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:46.299424 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:46.309400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:46.309887 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:46.310686 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:46.311126 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:46.371780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:46.379921 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a31532c0-bcb0-4632-ae08-856bdc53a11a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1219 microversion: 2.1 time: 0.087520 Apr 01 10:12:46.380462 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 371/748] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:46 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:46.992760 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:46.993756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:47.001831 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:47.002303 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:47.003138 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:47.003586 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:47.137735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:47.145966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:47.147508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:47.148788 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a026f64e-912a-4605-bba0-9d5cb373d758 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1739 microversion: 2.20 time: 0.162528 Apr 01 10:12:47.149358 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 378/749] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:46 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:47.397663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:47.398254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:47.404580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:47.405030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:47.405804 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:47.406237 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:47.467092 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7e73b5e40fca4a40b235f934b7573f22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3dc1f10cbf10469d8abe0641ae154834', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:47.475077 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3351892e-8bfd-4e99-9527-f01c1722559a tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 200 len: 1219 microversion: 2.1 time: 0.081261 Apr 01 10:12:47.475676 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 372/750] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:47 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:48.167820 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:48.168553 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:48.174627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:48.175095 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:48.175856 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:48.176284 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:48.406780 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:48.416418 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:48.418713 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:48.419877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ec8d008b-7be4-4fec-865f-a93a1de18dba tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1721 microversion: 2.20 time: 0.256468 Apr 01 10:12:48.420471 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 379/751] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:48 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:48.496800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:48.497443 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] [instance: 50585cb5-8edf-45ce-833d-3109010a299e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:48.504677 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:48.505175 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:48.506082 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:48.506541 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:48.521476 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] HTTP exception thrown: Instance 50585cb5-8edf-45ce-833d-3109010a299e could not be found. Apr 01 10:12:48.522028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Returning 404 to user: Instance 50585cb5-8edf-45ce-833d-3109010a299e could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:12:48.523052 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9aecd0f0-e468-4c9a-9e8f-2cda840be014 tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e" status: 404 len: 111 microversion: 2.1 time: 0.030496 Apr 01 10:12:48.523980 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 373/752] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:48 2022] GET /compute/v2.1/servers/50585cb5-8edf-45ce-833d-3109010a299e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:12:48.689472 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5b07de95-041a-4c52-9a57-6062f3324fdf tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] Calling method '.version_select at 0x7f64ed829430>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:48.708118 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5b07de95-041a-4c52-9a57-6062f3324fdf tempest-TestShelveInstance-1830325725 tempest-TestShelveInstance-1830325725-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1939095511" status: 202 len: 0 microversion: 2.1 time: 0.022618 Apr 01 10:12:48.708695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 380/753] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Apr 1 10:12:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1939095511 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:12:49.437760 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:49.438377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:49.444430 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:49.444884 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:49.445651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:49.446085 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:49.940547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:49.949115 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:49.950622 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:49.951906 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f31d379a-2177-4970-b2c0-3eacf6193d3b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1721 microversion: 2.20 time: 0.518211 Apr 01 10:12:49.952482 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 374/754] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:49 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1721 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:50.239302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-3c05798c-2c72-4151-9c44-09ad1b5220ff req-7c6b7fc5-1b05-4d9a-8296-d27310eebf5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b5d9e-6bee-443c-86e3-94e71c99643d", "name": "network-vif-unplugged", "status": "completed", "tag": "29223cc6-236b-47ca-8914-e65111046089"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:50.249707 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-3c05798c-2c72-4151-9c44-09ad1b5220ff req-7c6b7fc5-1b05-4d9a-8296-d27310eebf5b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:50.250149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-3c05798c-2c72-4151-9c44-09ad1b5220ff req-7c6b7fc5-1b05-4d9a-8296-d27310eebf5b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:50.263128 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-3c05798c-2c72-4151-9c44-09ad1b5220ff req-7c6b7fc5-1b05-4d9a-8296-d27310eebf5b service nova] Creating event network-vif-unplugged:29223cc6-236b-47ca-8914-e65111046089 for instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d on hv-cinder-maste Apr 01 10:12:50.272302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-3c05798c-2c72-4151-9c44-09ad1b5220ff req-7c6b7fc5-1b05-4d9a-8296-d27310eebf5b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037394 Apr 01 10:12:50.272926 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 381/755] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:12:50.970810 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:50.971387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:50.978416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:50.979258 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:50.980082 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:50.980759 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:51.228011 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:51.236317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:51.237808 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:51.239420 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cad54e2f-5c5d-42e3-adbd-a8deee1897d7 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1664 microversion: 2.20 time: 0.272677 Apr 01 10:12:51.239974 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 375/756] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:50 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1664 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:51.258301 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-96be9a21-4fef-4248-8f8a-3cb216b2fafb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5a2bda8-23ec-4d64-9822-135f7367d5c3"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:51.259501 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-96be9a21-4fef-4248-8f8a-3cb216b2fafb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:51.266811 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96be9a21-4fef-4248-8f8a-3cb216b2fafb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:51.267232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96be9a21-4fef-4248-8f8a-3cb216b2fafb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:51.268020 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96be9a21-4fef-4248-8f8a-3cb216b2fafb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:51.268450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-96be9a21-4fef-4248-8f8a-3cb216b2fafb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:51.559859 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:51.560355 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:51.566205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:51.566673 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:51.567443 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:51.568081 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:51.572792 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-96be9a21-4fef-4248-8f8a-3cb216b2fafb tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.319309 Apr 01 10:12:51.573988 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 382/757] 10.222.0.46 () {62 vars in 1363 bytes} [Fri Apr 1 10:12:51 2022] POST /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-volume_attachments => generated 188 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 01 10:12:51.659025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lazy-loading 'services' on Instance uuid 0f3070bf-3c0e-4e79-8129-264ad5e17aa1 {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:12:51.695736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c15bbab2-32c2-40bb-be54-00d03914795d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:51.696253 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c15bbab2-32c2-40bb-be54-00d03914795d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:51.703278 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c15bbab2-32c2-40bb-be54-00d03914795d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:51.704030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c15bbab2-32c2-40bb-be54-00d03914795d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:51.704978 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c15bbab2-32c2-40bb-be54-00d03914795d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:51.705571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c15bbab2-32c2-40bb-be54-00d03914795d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:51.748806 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-78c005e4-c802-4b34-ade9-db7353d0020f tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1/os-volume_attachments/eb6f3199-a040-4c21-87fa-6023208d577f" status: 202 len: 0 microversion: 2.1 time: 0.192663 Apr 01 10:12:51.754742 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 376/758] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:12:51 2022] DELETE /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1/os-volume_attachments/eb6f3199-a040-4c21-87fa-6023208d577f => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:12:52.026835 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c15bbab2-32c2-40bb-be54-00d03914795d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-volume_attachments/c5a2bda8-23ec-4d64-9822-135f7367d5c3" status: 202 len: 0 microversion: 2.20 time: 0.334866 Apr 01 10:12:52.027920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 383/759] 10.222.0.46 () {60 vars in 1456 bytes} [Fri Apr 1 10:12:51 2022] DELETE /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-volume_attachments/c5a2bda8-23ec-4d64-9822-135f7367d5c3 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Apr 01 10:12:52.091717 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6c2fa426-7dea-4f1a-b74e-82455deef1f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:52.092985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6c2fa426-7dea-4f1a-b74e-82455deef1f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:52.099791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6c2fa426-7dea-4f1a-b74e-82455deef1f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:52.100168 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6c2fa426-7dea-4f1a-b74e-82455deef1f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:52.101357 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6c2fa426-7dea-4f1a-b74e-82455deef1f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:52.102508 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6c2fa426-7dea-4f1a-b74e-82455deef1f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:52.219761 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6c2fa426-7dea-4f1a-b74e-82455deef1f2 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "POST /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/action" status: 202 len: 0 microversion: 2.20 time: 0.134206 Apr 01 10:12:52.220928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 377/760] 10.222.0.46 () {62 vars in 1318 bytes} [Fri Apr 1 10:12:52 2022] POST /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/action => generated 0 bytes in 136 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:12:52.228826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:52.229924 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:52.240077 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:52.240501 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:52.242484 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:52.243256 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:52.485814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:52.494060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:52.495576 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:52.496805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-9dc1817e-b31f-46bf-a580-d5a75bb3c279 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1672 microversion: 2.20 time: 0.271936 Apr 01 10:12:52.501661 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 384/761] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:52 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1672 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:12:52.932815 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:52.933498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:52.940001 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:52.940661 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:52.941601 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:52.942188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:52.969948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:12:53.050119 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-73ad2745-e73a-40d3-ab63-8e2d1be1390e tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 204 len: 0 microversion: 2.1 time: 0.120703 Apr 01 10:12:53.050960 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 378/762] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:12:52 2022] DELETE /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:12:53.060997 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:53.061818 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:53.068808 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:53.069491 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:53.070435 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:53.070899 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:53.209176 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:53.221768 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4042ec6d-a522-4911-b6fb-45b1ee6d28dc tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.165361 Apr 01 10:12:53.222377 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 385/763] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:53 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:53.516473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:53.517775 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:53.527351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:53.528698 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:53.531003 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:53.532231 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:54.076318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:54.085252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:54.087214 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:54.089182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1c67d75c-215c-4f0f-a4f2-4ae4e1b7b22a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.577171 Apr 01 10:12:54.090374 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 379/764] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:53 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:12:54.240966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:54.241575 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:54.256518 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:54.256976 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:54.257787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:54.258215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:54.431252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:54.441739 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c4ff3b32-74b8-4fe0-afc9-cc9d93eb60aa tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.205707 Apr 01 10:12:54.442957 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 386/765] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:54 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:55.108890 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:55.110138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:55.117148 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:55.117598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:55.118381 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:55.118865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:55.446781 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:55.455160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:55.456704 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:55.457893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8d1a616e-690c-421e-8454-ef577f6887fe tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.353466 Apr 01 10:12:55.458425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 380/766] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:55 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:55.459061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:55.459635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:55.466150 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:55.466812 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:55.467743 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:55.468378 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:55.607703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:55.615012 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4cab5b05-164f-4281-8382-ec0ad5115d2c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.159703 Apr 01 10:12:55.615787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 387/767] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:55 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:12:56.476585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:56.477252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:56.484032 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:56.484737 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:56.485957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:56.486553 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:56.632272 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:56.632871 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:56.645550 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:56.645910 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:56.646929 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:56.647525 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:56.667002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:56.678137 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:56.680262 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:56.681712 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-85de3a1a-cd3e-4def-8147-d3ac28e0ecfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.209222 Apr 01 10:12:56.692952 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 381/768] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:56 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:56.889216 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:56.899160 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8a68c210-6313-4601-851e-33858dc937d1 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.270751 Apr 01 10:12:56.899806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 388/769] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:56 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:57.363116 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-28fe8400-8230-44fc-9ae8-c7561dd1de2c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:57.363967 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-28fe8400-8230-44fc-9ae8-c7561dd1de2c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:57.370459 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28fe8400-8230-44fc-9ae8-c7561dd1de2c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:57.370954 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28fe8400-8230-44fc-9ae8-c7561dd1de2c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:57.371865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28fe8400-8230-44fc-9ae8-c7561dd1de2c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:57.372307 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-28fe8400-8230-44fc-9ae8-c7561dd1de2c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:57.396805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-28fe8400-8230-44fc-9ae8-c7561dd1de2c tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/ips" status: 200 len: 146 microversion: 2.1 time: 0.038281 Apr 01 10:12:57.397708 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 382/770] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:12:57 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:12:57.709283 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:57.709929 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:57.735641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:57.737403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:57.738317 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:57.738866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:57.916037 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:57.922104 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:57.922726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:57.931792 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:57.937028 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:57.938511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:57.939711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6384acb7-3199-491a-a5cc-73c51fccf104 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.239658 Apr 01 10:12:57.951037 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:57.951942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:57.952488 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:57.956557 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 389/771] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:57 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:58.096035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:58.104222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e1df7193-43e1-416c-b60f-c2d2f63525e3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.186177 Apr 01 10:12:58.104798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 383/772] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:57 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:12:58.782097 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b0867d6c-88cb-4ffa-abfc-0b6ed48a9fdb tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf6b8fb2-6904-4fe5-9055-5e0f33b95099"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:12:58.783345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b0867d6c-88cb-4ffa-abfc-0b6ed48a9fdb tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:58.790911 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b0867d6c-88cb-4ffa-abfc-0b6ed48a9fdb tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:58.791368 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b0867d6c-88cb-4ffa-abfc-0b6ed48a9fdb tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:58.792170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b0867d6c-88cb-4ffa-abfc-0b6ed48a9fdb tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:58.792612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b0867d6c-88cb-4ffa-abfc-0b6ed48a9fdb tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:58.964093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:58.964948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:58.971903 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:58.972350 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:58.973117 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:58.973542 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:59.113722 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:59.124256 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:59.125754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:59.126958 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-82d46b5b-164b-488c-90f8-990d702ac56e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.166866 Apr 01 10:12:59.127629 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 384/773] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:12:58 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:12:59.132310 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:12:59.133120 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:12:59.139481 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:59.139922 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:59.140894 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:12:59.141322 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:12:59.276924 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:12:59.284544 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ded2d48f-9f8d-4fdb-88eb-b06b6d45d599 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.155679 Apr 01 10:12:59.285242 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 385/774] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:12:59 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:00.145688 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:00.147863 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:00.154796 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:00.155277 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:00.156061 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:00.156498 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:00.298622 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:00.306811 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:00.308290 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:00.309493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3e897fdc-ed90-4943-a960-7345e10e8fac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.167896 Apr 01 10:13:00.310047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 386/775] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:00 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:00.324394 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:00.325206 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:00.331353 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:00.331802 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:00.332571 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:00.333004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:00.467965 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:00.475671 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b09450b3-e0bd-4dcb-ae29-df71fd1b7e71 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.164282 Apr 01 10:13:00.476249 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 387/776] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:00 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:01.328689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:01.329352 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:01.336168 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:01.336619 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:01.337397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:01.337834 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:01.475535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:01.483654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:01.485151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:01.486397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-570dd3d3-3bf4-4783-80fa-62bfaea51c8e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.162037 Apr 01 10:13:01.490714 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 388/777] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:01 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:01.492978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:01.493599 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:01.500064 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:01.500513 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:01.501324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:01.501756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:01.647031 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:01.651240 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ee1a15f7-d804-47d5-9448-397f516dd730 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.161914 Apr 01 10:13:01.651827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 389/778] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:01 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:02.506091 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:02.506767 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:02.513981 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:02.514294 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:02.515099 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:02.515533 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:02.655598 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:02.664229 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:02.665741 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:02.666956 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e2b4b010-841f-4692-931d-87319ff39f78 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.164847 Apr 01 10:13:02.667577 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 390/779] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:02 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:02.673065 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:02.673065 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:02.679130 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:02.679583 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:02.680351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:02.680780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:02.822231 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:02.830112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a84e3e3f-08a3-4cf4-90b4-35a328a9e339 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.161373 Apr 01 10:13:02.830937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 391/780] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:02 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:03.686039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:03.686749 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:03.693318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:03.693765 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:03.694518 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:03.695048 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:03.831822 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:03.839729 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:03.841266 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:03.842546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1ea4e15b-cc68-4280-8190-18549b45088c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.161740 Apr 01 10:13:03.843193 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 392/781] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:03 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:13:03.847745 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:03.848400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:03.854573 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:03.855071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:03.855916 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:03.856371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:03.994683 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:04.002515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b0de3eff-6678-4fb5-abd4-b0176ef40834 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.158287 Apr 01 10:13:04.003107 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 393/782] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:03 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:04.862576 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:04.863284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:04.870252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:04.870697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:04.871547 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:04.871980 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:05.016238 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:05.024209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:05.025739 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:05.026939 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-30312dd0-3cd8-4d53-91fc-f0ee0a98f047 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.168486 Apr 01 10:13:05.027525 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 394/783] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:04 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:13:05.032025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:05.032634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:05.039634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:05.040202 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:05.041093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:05.041567 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:05.180200 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:05.188122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0f49bdc1-b82e-4a00-befe-07dddc8b836b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.159555 Apr 01 10:13:05.188886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 395/784] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:05 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:06.049990 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:06.051139 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:06.061931 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:06.062714 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:06.064031 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:06.064744 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:06.207529 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:06.216062 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:06.217564 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:06.218750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-10d40c69-ac70-40d5-9fd0-3ab28b52af70 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.175582 Apr 01 10:13:06.219310 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 396/785] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:06 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:06.223729 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:06.224341 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:06.229973 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:06.230401 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:06.231236 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:06.231672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:06.366278 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:06.374453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-efca11c6-b2a0-4b6e-b23a-7dab883c53e4 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.154203 Apr 01 10:13:06.375070 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 397/786] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:06 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:07.241315 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:07.242391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:07.251145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:07.251595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:07.252359 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:07.252789 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:07.401786 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:07.410499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:07.411932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:07.413124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3751c123-b7e5-427e-b6c3-6508f1c05dd6 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.178533 Apr 01 10:13:07.413737 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 398/787] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:07 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:07.418144 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:07.418780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:07.424544 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:07.424989 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:07.425759 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:07.426209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:07.561660 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:07.573392 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6d717b45-9160-422a-8ac6-f50b704a9168 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.158645 Apr 01 10:13:07.574161 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 399/788] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:07 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:07.950927 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b0867d6c-88cb-4ffa-abfc-0b6ed48a9fdb tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 9.172568 Apr 01 10:13:07.951567 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 390/789] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:12:58 2022] POST /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments => generated 194 bytes in 9174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:08.432051 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:08.432699 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:08.439618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:08.440141 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:08.440916 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:08.441354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:08.578169 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:08.590365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:08.591895 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:08.592629 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:08.592927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:08.594768 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ea067188-bb41-403a-a397-123ab6788f9b tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.166776 Apr 01 10:13:08.595738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 400/790] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:08 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:08.601488 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:08.601940 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:08.602749 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:08.603949 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:08.834127 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:08.842870 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c0dee4ba-de57-4dde-abc0-d2dca4f54087 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 200 len: 1513 microversion: 2.1 time: 0.255082 Apr 01 10:13:08.843461 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 391/791] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:08 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 1513 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:13:09.003316 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-fea04eb5-b649-4313-8c82-85e9489b9cef req-0ee9c6b5-24ee-453e-b565-767082c3d571 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0f3070bf-3c0e-4e79-8129-264ad5e17aa1", "name": "network-vif-deleted", "tag": "991d8877-8dfb-4a18-9b25-395c5933b64f"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:09.012162 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-fea04eb5-b649-4313-8c82-85e9489b9cef req-0ee9c6b5-24ee-453e-b565-767082c3d571 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:09.012559 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-fea04eb5-b649-4313-8c82-85e9489b9cef req-0ee9c6b5-24ee-453e-b565-767082c3d571 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:09.023842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-fea04eb5-b649-4313-8c82-85e9489b9cef req-0ee9c6b5-24ee-453e-b565-767082c3d571 service nova] Creating event network-vif-deleted:991d8877-8dfb-4a18-9b25-395c5933b64f for instance 0f3070bf-3c0e-4e79-8129-264ad5e17aa1 on hv-cinder-maste Apr 01 10:13:09.028928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-fea04eb5-b649-4313-8c82-85e9489b9cef req-0ee9c6b5-24ee-453e-b565-767082c3d571 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029380 Apr 01 10:13:09.029999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 401/792] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:09.613478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:09.614048 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:09.620987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:09.621446 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:09.622229 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:09.622755 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:09.773655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:09.786115 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:09.788541 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:09.790264 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-17103d50-8ec4-4d61-b22e-c34797a2c9bf tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.180684 Apr 01 10:13:09.791063 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 392/793] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:09 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:09.863843 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:09.865017 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 0f3070bf-3c0e-4e79-8129-264ad5e17aa1] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:09.875580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:09.876232 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:09.877485 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:09.878216 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:09.895972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] HTTP exception thrown: Instance 0f3070bf-3c0e-4e79-8129-264ad5e17aa1 could not be found. Apr 01 10:13:09.896550 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Returning 404 to user: Instance 0f3070bf-3c0e-4e79-8129-264ad5e17aa1 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:13:09.897350 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-dd2e49b9-0d24-4215-a7fb-1a37e2928dbd tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1" status: 404 len: 111 microversion: 2.1 time: 0.041092 Apr 01 10:13:09.897870 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 402/794] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:09 2022] GET /compute/v2.1/servers/0f3070bf-3c0e-4e79-8129-264ad5e17aa1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:13:10.811207 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:10.811793 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:10.818607 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:10.819127 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:10.819904 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:10.820339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:10.958564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:10.966679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:10.968223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:10.969370 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d184eebb-922c-4946-98e3-23db73149285 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.162377 Apr 01 10:13:10.969914 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 393/795] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:10 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:11.988451 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:11.989087 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:11.995605 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:11.996060 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:11.996833 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:11.997274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:12.140007 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:12.148345 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:12.149861 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:12.151080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-573caccc-cba8-4c17-9e38-6195957a268c tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.166650 Apr 01 10:13:12.151647 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 403/796] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:11 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:13.169602 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:13.170224 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:13.177049 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:13.177508 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:13.178279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:13.178759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:13.316157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:13.324131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:13.325619 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:13.326999 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-87c94dae-fe12-4546-a039-15d514543d11 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.161473 Apr 01 10:13:13.328399 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 394/797] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:13 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:14.345800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:14.346411 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:14.353354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:14.353484 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:14.354204 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:14.354637 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:14.490899 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:14.501319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:14.502884 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:14.504090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-72c751a2-8966-4057-8298-de3d7f522c73 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.162399 Apr 01 10:13:14.505324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 404/798] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:14 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:15.523122 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:15.523950 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:15.531112 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:15.531557 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:15.532355 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:15.532785 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:15.674503 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:15.683253 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:15.684754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:15.685898 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-229d06cd-07cd-4688-991b-20021f0f9686 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.167267 Apr 01 10:13:15.686486 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 395/799] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:15 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:16.508858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5ed6033f-ff4b-4f57-9c6c-f749196dbab5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:16.509818 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5ed6033f-ff4b-4f57-9c6c-f749196dbab5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:16.516773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5ed6033f-ff4b-4f57-9c6c-f749196dbab5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:16.517222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5ed6033f-ff4b-4f57-9c6c-f749196dbab5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:16.517994 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5ed6033f-ff4b-4f57-9c6c-f749196dbab5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:16.518429 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5ed6033f-ff4b-4f57-9c6c-f749196dbab5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:16.547620 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5ed6033f-ff4b-4f57-9c6c-f749196dbab5 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042841 Apr 01 10:13:16.548164 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 405/800] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:13:16 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:16.558432 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-04fcfd81-5d9e-4906-847a-2fd43b107840 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:16.559334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-04fcfd81-5d9e-4906-847a-2fd43b107840 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:16.566637 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04fcfd81-5d9e-4906-847a-2fd43b107840 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:16.567129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04fcfd81-5d9e-4906-847a-2fd43b107840 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:16.567954 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04fcfd81-5d9e-4906-847a-2fd43b107840 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:16.568396 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-04fcfd81-5d9e-4906-847a-2fd43b107840 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:16.600015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-04fcfd81-5d9e-4906-847a-2fd43b107840 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/bf6b8fb2-6904-4fe5-9055-5e0f33b95099" status: 200 len: 194 microversion: 2.1 time: 0.045796 Apr 01 10:13:16.600611 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 396/801] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Apr 1 10:13:16 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/bf6b8fb2-6904-4fe5-9055-5e0f33b95099 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:16.704716 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:16.705318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:16.712705 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:16.713250 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:16.714440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:16.715097 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:16.831363 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-985dc5fd-a63b-4a43-8600-d191f74a7626 req-b64eb704-adb9-4ada-8624-7b912804c1e5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b5d9e-6bee-443c-86e3-94e71c99643d", "name": "network-vif-plugged", "status": "completed", "tag": "29223cc6-236b-47ca-8914-e65111046089"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:16.841208 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-985dc5fd-a63b-4a43-8600-d191f74a7626 req-b64eb704-adb9-4ada-8624-7b912804c1e5 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:16.841814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-985dc5fd-a63b-4a43-8600-d191f74a7626 req-b64eb704-adb9-4ada-8624-7b912804c1e5 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:16.855585 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-985dc5fd-a63b-4a43-8600-d191f74a7626 req-b64eb704-adb9-4ada-8624-7b912804c1e5 service nova] Creating event network-vif-plugged:29223cc6-236b-47ca-8914-e65111046089 for instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d on hv-cinder-maste Apr 01 10:13:16.861555 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-985dc5fd-a63b-4a43-8600-d191f74a7626 req-b64eb704-adb9-4ada-8624-7b912804c1e5 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035230 Apr 01 10:13:16.862753 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 397/802] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:13:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:16.890171 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:16.899727 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:16.901245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:16.902383 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e3e39b5e-2641-4bad-937f-d42fba1f9b50 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.201652 Apr 01 10:13:16.903275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 406/803] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:16 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:17.923839 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:17.924531 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:17.931194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:17.931651 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:17.932399 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:17.932864 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:18.065905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:18.075450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:18.076967 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:18.078131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-76187cce-cf4a-4db7-a54a-efa1219bfcfa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.159971 Apr 01 10:13:18.078946 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 398/804] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:17 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:19.100681 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:19.101697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:19.112299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:19.113035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:19.114319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:19.115068 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:19.254918 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:19.263693 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:19.265211 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:19.266363 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bf37c1cf-62a6-40f5-b3c4-ca5c2af48fd9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.172393 Apr 01 10:13:19.266953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 407/805] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:19 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:20.293888 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:20.294814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:20.305681 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:20.306405 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:20.307767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:20.308498 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:20.451832 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:20.460155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:20.461655 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:20.462862 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8328af25-6451-4999-9c75-aadf7c92f66e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.175635 Apr 01 10:13:20.463425 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 399/806] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:20 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:21.485060 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:21.485699 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:21.493507 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:21.494219 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:21.494815 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:21.495275 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:21.631183 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:21.639402 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:21.640927 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:21.642080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5c35f67a-5579-4e54-90f8-6fe878c680fa tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.163336 Apr 01 10:13:21.642616 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 408/807] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:21 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:21.876848 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1453496331", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "networks": [{"uuid": "7bfcac4a-d60e-4922-b594-c3472a473d4a"}]}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:21.931767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] validate_networks() for [('7bfcac4a-d60e-4922-b594-c3472a473d4a', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:13:22.168190 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6d9f6713-1e85-41bc-aec0-f8178d3b294b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9d1f4bec-6d40-4e59-9e05-c42bb3b3271b"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:22.169272 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6d9f6713-1e85-41bc-aec0-f8178d3b294b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:22.175672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d9f6713-1e85-41bc-aec0-f8178d3b294b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:22.176184 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d9f6713-1e85-41bc-aec0-f8178d3b294b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:22.177027 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d9f6713-1e85-41bc-aec0-f8178d3b294b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:22.177462 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6d9f6713-1e85-41bc-aec0-f8178d3b294b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:22.390127 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:13:22.390565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:13:22.391073 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:13:22.391478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:13:22.391883 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:13:22.401243 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:22.401724 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:22.402579 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:22.403045 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:22.421800 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Getting quotas for project bbdc40573f43486bb7c7a2fc5f262033. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:13:22.426225 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Getting quotas for user ac87a6bd2eef40c58f71e7a787e18651 and project bbdc40573f43486bb7c7a2fc5f262033. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:13:22.438214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:13:22.440554 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:13:22.486588 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6d9f6713-1e85-41bc-aec0-f8178d3b294b tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "POST /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.322082 Apr 01 10:13:22.491098 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 409/808] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:13:22 2022] POST /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments => generated 194 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:13:22.499045 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1244baaf-5274-4762-a880-568dc980c8d5 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.624237 Apr 01 10:13:22.502918 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 400/809] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:13:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:13:22.509549 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1f814ad4-e741-46cd-a933-8363c5e3dd6b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:22.510262 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1f814ad4-e741-46cd-a933-8363c5e3dd6b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:22.595863 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1f814ad4-e741-46cd-a933-8363c5e3dd6b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:22.603017 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1f814ad4-e741-46cd-a933-8363c5e3dd6b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1219 microversion: 2.1 time: 0.098351 Apr 01 10:13:22.603985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 410/810] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:22 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:22.660536 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:22.661155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:22.667955 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:22.668175 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:22.669161 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:22.669628 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:22.825062 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:22.833784 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:22.835653 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:22.837050 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-703631be-9f3d-43c5-9789-0b55081aa5d9 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1730 microversion: 2.20 time: 0.180629 Apr 01 10:13:22.837684 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 401/811] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:22 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1730 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:23.620166 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:23.620858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:23.628449 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:23.628888 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:23.629751 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:23.630200 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:23.689594 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:23.697515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3eb9647f-1a5d-4f1d-8a14-a2f6d28eaead tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1277 microversion: 2.1 time: 0.081763 Apr 01 10:13:23.698073 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 411/812] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:23 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1277 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:23.860218 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:23.861054 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:23.868036 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:23.868479 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:23.869247 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:23.869670 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:24.087465 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:24.096491 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:24.099494 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:24.100734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e06fb477-bda0-4eca-9ab3-f9258e00ecac tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1717 microversion: 2.20 time: 0.247574 Apr 01 10:13:24.101401 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 402/813] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:13:23 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1717 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:13:24.715807 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:24.716428 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:24.723324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:24.724053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:24.724805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:24.725523 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:24.857591 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:24.865339 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bc53d352-fcc9-4eee-9c4d-1c2136a93377 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1319 microversion: 2.1 time: 0.153574 Apr 01 10:13:24.865893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 412/814] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:24 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:24.879975 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-a03da311-7a9f-4814-a534-6b556958aa65 req-897ea5ad-1bd4-4e93-81a0-8141e65411f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "224b43fa-8f79-4d0c-9730-f8f733a7490f", "tag": "fe496882-2fde-4cc7-811f-49b0c766fdee"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:24.889906 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-a03da311-7a9f-4814-a534-6b556958aa65 req-897ea5ad-1bd4-4e93-81a0-8141e65411f7 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:24.890593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-a03da311-7a9f-4814-a534-6b556958aa65 req-897ea5ad-1bd4-4e93-81a0-8141e65411f7 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:24.902360 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-a03da311-7a9f-4814-a534-6b556958aa65 req-897ea5ad-1bd4-4e93-81a0-8141e65411f7 service nova] Creating event network-changed:fe496882-2fde-4cc7-811f-49b0c766fdee for instance 224b43fa-8f79-4d0c-9730-f8f733a7490f on hv-cinder-maste Apr 01 10:13:24.907967 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-a03da311-7a9f-4814-a534-6b556958aa65 req-897ea5ad-1bd4-4e93-81a0-8141e65411f7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031733 Apr 01 10:13:24.908588 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 403/815] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:25.886807 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:25.887915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:25.897082 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:25.897541 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:25.898318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:25.898777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:26.037286 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:26.048651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1a43b08f-3e08-4da9-97a0-b95b0391a553 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1319 microversion: 2.1 time: 0.168367 Apr 01 10:13:26.049415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 413/816] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:25 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:27.066727 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:27.067399 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:27.074466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:27.074945 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:27.075719 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:27.076157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:27.218495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:27.226403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b2ddc742-28b3-4e5e-a74b-bc9114176dc3 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1319 microversion: 2.1 time: 0.164183 Apr 01 10:13:27.227017 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 404/817] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:27 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:28.248332 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:28.249314 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:28.260132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:28.261276 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:28.262606 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:28.263371 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:28.407047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:28.415196 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f16a59ec-f8a8-452b-a663-818fe821c77c tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1319 microversion: 2.1 time: 0.173501 Apr 01 10:13:28.415750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 414/818] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:28 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:29.432028 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:29.432631 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:29.439797 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:29.440217 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:29.441241 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:29.441674 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:29.580406 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:29.588651 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c926c12f-8223-4fb2-8d62-2d213a26fa44 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1319 microversion: 2.1 time: 0.160609 Apr 01 10:13:29.589252 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 405/819] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:29 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:30.013625 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c437190d-0b85-4639-a12d-18150c3338ea tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:30.015166 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c437190d-0b85-4639-a12d-18150c3338ea tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:30.024652 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c437190d-0b85-4639-a12d-18150c3338ea tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.025285 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c437190d-0b85-4639-a12d-18150c3338ea tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.026447 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c437190d-0b85-4639-a12d-18150c3338ea tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.027002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c437190d-0b85-4639-a12d-18150c3338ea tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.071416 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c437190d-0b85-4639-a12d-18150c3338ea tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.063690 Apr 01 10:13:30.072021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 415/820] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:13:30 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments => generated 371 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:30.236435 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4836689a-c916-497c-8c3e-578e046bc19e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:30.237142 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4836689a-c916-497c-8c3e-578e046bc19e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:30.245116 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4836689a-c916-497c-8c3e-578e046bc19e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.245573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4836689a-c916-497c-8c3e-578e046bc19e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.246349 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4836689a-c916-497c-8c3e-578e046bc19e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.246815 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4836689a-c916-497c-8c3e-578e046bc19e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.275349 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4836689a-c916-497c-8c3e-578e046bc19e tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/bf6b8fb2-6904-4fe5-9055-5e0f33b95099" status: 200 len: 194 microversion: 2.1 time: 0.045930 Apr 01 10:13:30.275925 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 406/821] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Apr 1 10:13:30 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/bf6b8fb2-6904-4fe5-9055-5e0f33b95099 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:30.288473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:30.288956 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:30.295424 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.295845 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.296612 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.297035 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.376756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lazy-loading 'services' on Instance uuid 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:13:30.458530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8ea9d288-065d-42c4-b3b8-5ea626cc5dd9 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/bf6b8fb2-6904-4fe5-9055-5e0f33b95099" status: 202 len: 0 microversion: 2.1 time: 0.173854 Apr 01 10:13:30.459222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 416/822] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:13:30 2022] DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/bf6b8fb2-6904-4fe5-9055-5e0f33b95099 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:13:30.609351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:30.610348 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:30.620944 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.621654 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.623079 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.623963 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.768309 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:30.776539 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-023c78d6-ab7d-4367-9ef4-bfdb51f7a275 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1319 microversion: 2.1 time: 0.173528 Apr 01 10:13:30.777117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 407/823] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:30 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:30.891677 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-6c9ae8fb-a60e-4ff6-8dc5-889247b2e35f req-756b5f29-d996-477a-bd92-42b3bb444e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b43fa-8f79-4d0c-9730-f8f733a7490f", "name": "network-vif-plugged", "status": "completed", "tag": "fe496882-2fde-4cc7-811f-49b0c766fdee"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:30.900741 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-6c9ae8fb-a60e-4ff6-8dc5-889247b2e35f req-756b5f29-d996-477a-bd92-42b3bb444e01 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:30.901229 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-6c9ae8fb-a60e-4ff6-8dc5-889247b2e35f req-756b5f29-d996-477a-bd92-42b3bb444e01 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:30.912823 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-6c9ae8fb-a60e-4ff6-8dc5-889247b2e35f req-756b5f29-d996-477a-bd92-42b3bb444e01 service nova] Creating event network-vif-plugged:fe496882-2fde-4cc7-811f-49b0c766fdee for instance 224b43fa-8f79-4d0c-9730-f8f733a7490f on hv-cinder-maste Apr 01 10:13:30.917812 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-6c9ae8fb-a60e-4ff6-8dc5-889247b2e35f req-756b5f29-d996-477a-bd92-42b3bb444e01 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031187 Apr 01 10:13:30.918431 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 417/824] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:31.793921 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:31.794499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:31.801299 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:31.801759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:31.802541 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:31.803015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:31.947915 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:31.955762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-61b4d0fc-6cef-4da4-a916-36d85c678769 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1319 microversion: 2.1 time: 0.165990 Apr 01 10:13:31.956345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 408/825] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:31 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:32.626351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0fcd587d-5e0a-424d-850b-ab18c0cc98fe tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:32.626957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0fcd587d-5e0a-424d-850b-ab18c0cc98fe tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:32.633440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0fcd587d-5e0a-424d-850b-ab18c0cc98fe tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:32.633893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0fcd587d-5e0a-424d-850b-ab18c0cc98fe tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:32.634734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0fcd587d-5e0a-424d-850b-ab18c0cc98fe tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:32.635168 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0fcd587d-5e0a-424d-850b-ab18c0cc98fe tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:32.663891 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0fcd587d-5e0a-424d-850b-ab18c0cc98fe tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/9d1f4bec-6d40-4e59-9e05-c42bb3b3271b" status: 200 len: 194 microversion: 2.1 time: 0.042455 Apr 01 10:13:32.664515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 418/826] 10.222.0.46 () {58 vars in 1412 bytes} [Fri Apr 1 10:13:32 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/9d1f4bec-6d40-4e59-9e05-c42bb3b3271b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:13:32.674450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:32.674998 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:32.681044 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:32.681496 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:32.682271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:32.682734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:32.764336 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.objects.instance [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lazy-loading 'services' on Instance uuid 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 {{(pid=117066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:13:32.859009 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-bdcb7e36-63a3-406f-85be-9f6f727ec327 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/9d1f4bec-6d40-4e59-9e05-c42bb3b3271b" status: 202 len: 0 microversion: 2.1 time: 0.188308 Apr 01 10:13:32.860272 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 409/827] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:13:32 2022] DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments/9d1f4bec-6d40-4e59-9e05-c42bb3b3271b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:13:32.976441 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:32.977355 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:32.983616 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:32.984070 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:32.984836 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:32.985271 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:33.121100 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:33.129302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5e904b26-e566-4abf-89bf-31096d3ef30b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1507 microversion: 2.1 time: 0.159354 Apr 01 10:13:33.129901 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 419/828] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:32 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:13:33.146959 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d1152c7d-d090-4c4d-a88c-3b24c0525546 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b1f9648-f302-494c-ad6d-6329dfd2e3ee", "device": "/dev/sdb"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:33.148689 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d1152c7d-d090-4c4d-a88c-3b24c0525546 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:33.155444 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d1152c7d-d090-4c4d-a88c-3b24c0525546 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:33.155897 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d1152c7d-d090-4c4d-a88c-3b24c0525546 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:33.156785 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d1152c7d-d090-4c4d-a88c-3b24c0525546 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:33.157223 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d1152c7d-d090-4c4d-a88c-3b24c0525546 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:33.410471 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d1152c7d-d090-4c4d-a88c-3b24c0525546 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "POST /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.267740 Apr 01 10:13:33.411123 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 410/829] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:13:33 2022] POST /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:34.038597 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-97c28bd4-0b70-4640-970a-4198f9f85438 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:34.039770 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-97c28bd4-0b70-4640-970a-4198f9f85438 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:34.047160 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-97c28bd4-0b70-4640-970a-4198f9f85438 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.047611 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-97c28bd4-0b70-4640-970a-4198f9f85438 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.048391 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-97c28bd4-0b70-4640-970a-4198f9f85438 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.048814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-97c28bd4-0b70-4640-970a-4198f9f85438 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.078689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-97c28bd4-0b70-4640-970a-4198f9f85438 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046587 Apr 01 10:13:34.079292 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 420/830] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:13:34 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:13:34.200564 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f8bf54b9-adc2-41ee-bd9b-93c7003c2d97 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:34.201592 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f8bf54b9-adc2-41ee-bd9b-93c7003c2d97 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:34.208648 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8bf54b9-adc2-41ee-bd9b-93c7003c2d97 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.209065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8bf54b9-adc2-41ee-bd9b-93c7003c2d97 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.209847 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8bf54b9-adc2-41ee-bd9b-93c7003c2d97 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.210348 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f8bf54b9-adc2-41ee-bd9b-93c7003c2d97 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.244966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f8bf54b9-adc2-41ee-bd9b-93c7003c2d97 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049598 Apr 01 10:13:34.245587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 411/831] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:13:34 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:13:34.304985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:34.305492 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:34.311932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.312754 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.313814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.314262 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.339039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:13:34.426444 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1b19886a-d48b-4bc6-b801-994e174effcc tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 204 len: 0 microversion: 2.1 time: 0.125426 Apr 01 10:13:34.426972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 421/832] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:13:34 2022] DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:13:34.438959 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:34.439797 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:34.446620 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.447103 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.448150 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:34.448577 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:34.593210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:34.601006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-68bdb077-b368-4f65-983c-9b910b111f9d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1674 microversion: 2.1 time: 0.168294 Apr 01 10:13:34.601614 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 412/833] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:34 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1674 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:35.619349 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:35.620054 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:35.627252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:35.627734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:35.628505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:35.628941 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:35.783078 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:35.795615 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-64356fe6-ced7-4ff6-ac3a-bdb1e73eff22 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1674 microversion: 2.1 time: 0.180324 Apr 01 10:13:35.796446 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 422/834] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:35 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1674 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:36.818885 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:36.819439 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:36.826387 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:36.826840 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:36.827692 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:36.828189 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:37.033609 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:37.042075 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f42a2369-27ef-469e-a9a1-ef11a8db7f42 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1674 microversion: 2.1 time: 0.227292 Apr 01 10:13:37.042661 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 413/835] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:36 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1674 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:37.789845 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-26968849-f70a-4698-b460-9394065a0fbc req-970fc7d4-d039-4d04-8a7a-de284144f069 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "857c3a0e-4b47-48d0-a1a6-fe530160b9b9", "name": "network-vif-deleted", "tag": "2192815c-21e5-45b9-9276-0015b17f5100"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:37.800273 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-26968849-f70a-4698-b460-9394065a0fbc req-970fc7d4-d039-4d04-8a7a-de284144f069 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:37.800795 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-26968849-f70a-4698-b460-9394065a0fbc req-970fc7d4-d039-4d04-8a7a-de284144f069 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:37.815065 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-26968849-f70a-4698-b460-9394065a0fbc req-970fc7d4-d039-4d04-8a7a-de284144f069 service nova] Creating event network-vif-deleted:2192815c-21e5-45b9-9276-0015b17f5100 for instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 on hv-cinder-maste Apr 01 10:13:37.821830 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-26968849-f70a-4698-b460-9394065a0fbc req-970fc7d4-d039-4d04-8a7a-de284144f069 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035584 Apr 01 10:13:37.825767 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 423/836] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:13:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:38.060390 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:38.061740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:38.068865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:38.069332 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:38.070161 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:38.070602 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:38.101639 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:38.102078 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:38.102529 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.objects.instance [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lazy-loading 'fault' on Instance uuid 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 {{(pid=117066) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:13:38.149679 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6cc94b4e59c4b3ba507cc2e696e1a37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8abd12555c7642749049eaaedec0cbc1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:38.157896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a7dd2ad5-ea94-4301-9145-f90aed11908d tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 200 len: 1328 microversion: 2.1 time: 0.101907 Apr 01 10:13:38.162814 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 414/837] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:38 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 1328 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:39.176257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:39.176977 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:39.184364 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:39.184814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:39.185602 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:39.186043 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:39.199835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] HTTP exception thrown: Instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 could not be found. Apr 01 10:13:39.200455 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Returning 404 to user: Instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:13:39.201403 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1d78d460-b9a0-4070-9977-602b8d63130f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 404 len: 111 microversion: 2.1 time: 0.029575 Apr 01 10:13:39.201950 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 424/838] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:39 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:13:39.213589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f61b0524-df31-4e47-9398-8cffa4600092 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '.version_select at 0x7f64ed98dca0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:39.235058 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f61b0524-df31-4e47-9398-8cffa4600092 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115188567" status: 202 len: 0 microversion: 2.1 time: 0.027714 Apr 01 10:13:39.235632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 415/839] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Apr 1 10:13:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2115188567 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:13:46.663982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:46.664512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:46.671455 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:46.672033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:46.672820 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:46.673259 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:46.688321 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] HTTP exception thrown: Instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 could not be found. Apr 01 10:13:46.688932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Returning 404 to user: Instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:13:46.689800 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d94dbd99-2018-4576-9a9a-9f0e64a51164 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 404 len: 111 microversion: 2.1 time: 0.029875 Apr 01 10:13:46.690339 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 425/840] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:13:46 2022] DELETE /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:13:46.699295 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:46.699910 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 857c3a0e-4b47-48d0-a1a6-fe530160b9b9] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:46.707461 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:46.707916 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:46.708735 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:46.709172 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:46.722280 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] HTTP exception thrown: Instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 could not be found. Apr 01 10:13:46.722877 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Returning 404 to user: Instance 857c3a0e-4b47-48d0-a1a6-fe530160b9b9 could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:13:46.723747 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c6188841-9e95-4ad6-ac19-5cf880b47984 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9" status: 404 len: 111 microversion: 2.1 time: 0.029069 Apr 01 10:13:46.724271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 416/841] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:46 2022] GET /compute/v2.1/servers/857c3a0e-4b47-48d0-a1a6-fe530160b9b9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:13:52.086536 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:52.087101 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:52.094008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:52.094474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:52.095288 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:52.095725 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:52.109736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] HTTP exception thrown: Instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca could not be found. Apr 01 10:13:52.110329 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Returning 404 to user: Instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:13:52.111188 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4a0f447c-a58e-48c9-a132-20d34651ed7f tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 404 len: 111 microversion: 2.1 time: 0.028585 Apr 01 10:13:52.111717 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 426/842] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:13:52 2022] DELETE /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:13:52.120096 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:52.120685 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] [instance: 7fecc8e1-f340-4be9-8243-7369fcf1dbca] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:52.127379 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:52.127826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:52.128605 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:52.129040 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:52.142583 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] HTTP exception thrown: Instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca could not be found. Apr 01 10:13:52.143198 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] Returning 404 to user: Instance 7fecc8e1-f340-4be9-8243-7369fcf1dbca could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:13:52.144019 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-039db8a8-7ea6-4617-a390-cd1d22d17252 tempest-AttachVolumeTestJSON-1663020915 tempest-AttachVolumeTestJSON-1663020915-project] 10.222.0.46 "GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca" status: 404 len: 111 microversion: 2.1 time: 0.027950 Apr 01 10:13:52.144547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 417/843] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:52 2022] GET /compute/v2.1/servers/7fecc8e1-f340-4be9-8243-7369fcf1dbca => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:13:54.865247 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:54.868040 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:54.880198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:54.880677 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:54.881761 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:54.882205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:54.986709 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lazy-loading 'services' on Instance uuid 224b43fa-8f79-4d0c-9730-f8f733a7490f {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:13:55.067205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-89f286d9-05b5-484c-aa7c-97f2fc432328 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "DELETE /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f/os-volume_attachments/5b1f9648-f302-494c-ad6d-6329dfd2e3ee" status: 202 len: 0 microversion: 2.1 time: 0.208899 Apr 01 10:13:55.085072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 427/844] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:13:54 2022] DELETE /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f/os-volume_attachments/5b1f9648-f302-494c-ad6d-6329dfd2e3ee => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:13:56.191762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:56.192257 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:56.198371 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:56.198862 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:56.199632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:56.200059 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:56.223924 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:13:56.304483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-13b24aa7-4d93-4246-bddf-5580949cc525 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "DELETE /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 204 len: 0 microversion: 2.1 time: 0.116099 Apr 01 10:13:56.305383 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 418/845] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:13:56 2022] DELETE /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:13:56.315338 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:56.316165 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:56.322997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:56.323444 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:56.324244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:56.324672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:56.459954 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:56.469037 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6fa34e71-b14f-4a30-ad4c-1611aed80242 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1513 microversion: 2.1 time: 0.156399 Apr 01 10:13:56.469037 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 428/846] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:56 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:57.486065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:57.486972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:57.498202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:57.498806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:57.499706 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:57.500264 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:57.729982 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:57.737893 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-56d15f90-6423-4d61-ac4b-7fe9eac0cb12 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1513 microversion: 2.1 time: 0.256394 Apr 01 10:13:57.738846 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 419/847] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:57 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:58.757209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:58.757834 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:58.765975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:58.766435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:58.767734 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:58.768538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:58.943865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac87a6bd2eef40c58f71e7a787e18651', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbdc40573f43486bb7c7a2fc5f262033', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:13:58.952495 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4019916c-9850-4acb-9510-9e637a196b9b tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 200 len: 1513 microversion: 2.1 time: 0.200659 Apr 01 10:13:58.953196 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 429/848] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:58 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 1513 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:13:59.220987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-d22664d4-436f-407e-8b07-0beacb57b44b req-51d90d15-8bd1-40dc-85ed-1e069017f6f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "224b43fa-8f79-4d0c-9730-f8f733a7490f", "name": "network-vif-deleted", "tag": "fe496882-2fde-4cc7-811f-49b0c766fdee"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:13:59.235734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-d22664d4-436f-407e-8b07-0beacb57b44b req-51d90d15-8bd1-40dc-85ed-1e069017f6f6 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:59.237547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-d22664d4-436f-407e-8b07-0beacb57b44b req-51d90d15-8bd1-40dc-85ed-1e069017f6f6 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:59.252960 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-d22664d4-436f-407e-8b07-0beacb57b44b req-51d90d15-8bd1-40dc-85ed-1e069017f6f6 service nova] Creating event network-vif-deleted:fe496882-2fde-4cc7-811f-49b0c766fdee for instance 224b43fa-8f79-4d0c-9730-f8f733a7490f on hv-cinder-maste Apr 01 10:13:59.260371 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-d22664d4-436f-407e-8b07-0beacb57b44b req-51d90d15-8bd1-40dc-85ed-1e069017f6f6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043052 Apr 01 10:13:59.260977 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 420/849] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:13:59.969840 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:13:59.970835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] [instance: 224b43fa-8f79-4d0c-9730-f8f733a7490f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:13:59.977225 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:59.977676 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:59.978451 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:13:59.978924 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:13:59.992349 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] HTTP exception thrown: Instance 224b43fa-8f79-4d0c-9730-f8f733a7490f could not be found. Apr 01 10:13:59.993374 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] Returning 404 to user: Instance 224b43fa-8f79-4d0c-9730-f8f733a7490f could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:13:59.994183 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-23b72f33-f9dd-4925-ae62-54986662be37 tempest-VolumesSnapshotTestJSON-1452270562 tempest-VolumesSnapshotTestJSON-1452270562-project] 10.222.0.46 "GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f" status: 404 len: 111 microversion: 2.1 time: 0.028339 Apr 01 10:13:59.994746 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 430/850] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:13:59 2022] GET /compute/v2.1/servers/224b43fa-8f79-4d0c-9730-f8f733a7490f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:14:01.587738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8fcd79e6-ae5f-40a3-be80-9684699063dd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: .version_select at 0x7f64ed97e940>, body: {"keypair": {"name": "tempest-keypair-96812753"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:01.603128 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-8fcd79e6-ae5f-40a3-be80-9684699063dd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:14:01.607581 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-8fcd79e6-ae5f-40a3-be80-9684699063dd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:14:01.940766 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-8fcd79e6-ae5f-40a3-be80-9684699063dd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:14:01.944571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-8fcd79e6-ae5f-40a3-be80-9684699063dd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:14:01.957998 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8fcd79e6-ae5f-40a3-be80-9684699063dd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.499149 Apr 01 10:14:01.958629 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 421/851] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:14:01 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:03.223152 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2034406084", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9da82d1d-4bc1-4295-8708-e98235a59efd"}], "security_groups": [{"name": "tempest-securitygroup--1665017261"}], "key_name": "tempest-keypair-96812753", "user_data": "}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:03.424279 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] validate_networks() for [('9da82d1d-4bc1-4295-8708-e98235a59efd', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:14:03.835929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:14:03.836670 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:14:03.837478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:14:03.838109 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:14:03.838496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:14:03.848571 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:03.849301 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:03.850403 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:03.851187 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:03.871145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:14:03.876951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:14:03.890209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:14:03.893660 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:14:03.953029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e087612c-4be0-42fa-91ac-d72c942e1752 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.734900 Apr 01 10:14:03.954302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 431/852] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:14:03 2022] POST /compute/v2.1/servers => generated 402 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:14:03.966343 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cdb00cc5-8cdb-449d-981c-de31ceddace6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:03.967333 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cdb00cc5-8cdb-449d-981c-de31ceddace6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:04.113061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-cdb00cc5-8cdb-449d-981c-de31ceddace6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:04.120423 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cdb00cc5-8cdb-449d-981c-de31ceddace6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1240 microversion: 2.1 time: 0.159907 Apr 01 10:14:04.121320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 422/853] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:03 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1240 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:05.138594 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:05.139342 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:05.147132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:05.147663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:05.148557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:05.149041 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:05.213341 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:05.220918 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-937631d0-d33f-4f10-8536-6713dddf2a62 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1244 microversion: 2.1 time: 0.087218 Apr 01 10:14:05.221488 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 432/854] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:05 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1244 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:06.238212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:06.239034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:06.245913 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:06.246367 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:06.247174 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:06.247610 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:06.323193 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:06.331131 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-71ec7063-ee67-451a-a24f-7640949168f5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1298 microversion: 2.1 time: 0.096822 Apr 01 10:14:06.331936 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 423/855] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:06 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:07.239611 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-e2c95838-36ca-44d7-a43f-29d9f0e7fae0 req-bf4231ea-8e91-4f6c-8bbe-a58bc031be5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faab71c0-1bab-48db-9b41-e6e8c908ea57", "tag": "7c832b8f-5482-4867-93bb-63c19a50ffba"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:07.248980 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-e2c95838-36ca-44d7-a43f-29d9f0e7fae0 req-bf4231ea-8e91-4f6c-8bbe-a58bc031be5e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:07.256356 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-e2c95838-36ca-44d7-a43f-29d9f0e7fae0 req-bf4231ea-8e91-4f6c-8bbe-a58bc031be5e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:07.268791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-e2c95838-36ca-44d7-a43f-29d9f0e7fae0 req-bf4231ea-8e91-4f6c-8bbe-a58bc031be5e service nova] Creating event network-changed:7c832b8f-5482-4867-93bb-63c19a50ffba for instance faab71c0-1bab-48db-9b41-e6e8c908ea57 on hv-cinder-maste Apr 01 10:14:07.273919 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-e2c95838-36ca-44d7-a43f-29d9f0e7fae0 req-bf4231ea-8e91-4f6c-8bbe-a58bc031be5e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038068 Apr 01 10:14:07.275423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 433/856] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:14:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:14:07.349729 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:07.350360 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:07.361267 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:07.361753 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:07.362767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:07.363410 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:07.569828 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:07.577799 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cdb8c6dc-8771-4507-95d5-6ca96b1e6028 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.232771 Apr 01 10:14:07.578381 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 424/857] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:07 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:08.595978 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:08.596664 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:08.604403 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:08.604879 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:08.605688 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:08.606262 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:08.756936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:08.765071 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3f177a23-675c-4c82-b41a-f7c0c158abe9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.174223 Apr 01 10:14:08.765634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 434/858] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:08 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:09.783741 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:09.784359 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:09.790953 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:09.791410 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:09.792189 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:09.792640 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:10.205030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:10.213604 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f0d59167-ff48-43c4-8c9b-72762d64e554 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.433862 Apr 01 10:14:10.214178 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 425/859] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:09 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:11.234565 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:11.235865 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:11.246663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:11.247132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:11.247942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:11.248375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:11.389910 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:11.401421 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-91b8a8bb-54b2-4e33-90ed-70e80335b66a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.172963 Apr 01 10:14:11.402177 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 435/860] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:11 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:12.422915 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:12.423873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:12.434873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:12.435635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:12.436902 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:12.437631 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:12.583167 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:12.591329 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6a9a8182-cd9a-4616-a63c-fc467ea66cd5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.175042 Apr 01 10:14:12.591904 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 426/861] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:12 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:13.613326 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:13.614274 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:13.624969 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:13.625731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:13.627039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:13.627778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:13.776871 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:13.788029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-aa77c0bf-b693-41f2-b08c-81ba2edb77a2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.181862 Apr 01 10:14:13.788764 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 436/862] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:13 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:14.808000 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:14.808578 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:14.815469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:14.815890 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:14.816695 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:14.817124 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:14.957504 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:14.965168 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-490ab1ff-c463-4389-bd7c-00d642cef7ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.163481 Apr 01 10:14:14.965889 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 427/863] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:14 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:15.985672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:15.986373 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:15.992592 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:15.993047 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:15.993813 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:15.994254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:16.025836 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:14:16.026295 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:14:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 (ip 10.222.0.46) !!! Apr 01 10:14:16.133626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:16.142050 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cbc4171a-7fb6-4350-b283-be5761246c12 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.163023 Apr 01 10:14:16.142626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 437/864] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:15 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:17.163274 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:17.164308 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:17.175270 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:17.176016 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:17.177319 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:17.178025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:17.317340 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:17.324837 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d82b8100-b5e7-4957-9e4a-33de81d5d09d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.168309 Apr 01 10:14:17.325415 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 428/865] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:17 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:17.466125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-6a241c8f-7998-4c6e-a802-ed24debf7800 req-b737dc50-b7fc-4a30-a863-43b7eaaed7d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faab71c0-1bab-48db-9b41-e6e8c908ea57", "name": "network-vif-plugged", "status": "completed", "tag": "7c832b8f-5482-4867-93bb-63c19a50ffba"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:17.476549 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-6a241c8f-7998-4c6e-a802-ed24debf7800 req-b737dc50-b7fc-4a30-a863-43b7eaaed7d3 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:17.476982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-6a241c8f-7998-4c6e-a802-ed24debf7800 req-b737dc50-b7fc-4a30-a863-43b7eaaed7d3 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:17.491280 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-6a241c8f-7998-4c6e-a802-ed24debf7800 req-b737dc50-b7fc-4a30-a863-43b7eaaed7d3 service nova] Creating event network-vif-plugged:7c832b8f-5482-4867-93bb-63c19a50ffba for instance faab71c0-1bab-48db-9b41-e6e8c908ea57 on hv-cinder-maste Apr 01 10:14:17.494130 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-6a241c8f-7998-4c6e-a802-ed24debf7800 req-b737dc50-b7fc-4a30-a863-43b7eaaed7d3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031729 Apr 01 10:14:17.494959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 438/866] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:14:18.344616 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:18.345235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:18.353218 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:18.353802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:18.354836 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:18.355579 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:18.500456 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:18.508004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-fd3b819b-4b5d-4c0d-ae91-8bc9a91901e8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1366 microversion: 2.1 time: 0.169209 Apr 01 10:14:18.508574 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 429/867] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:18 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1366 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:19.529918 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:19.530805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:19.540972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:19.541646 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:19.542875 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:19.543515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:19.687967 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:19.695505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b48508bb-59d5-494e-8449-3b58f1c3e90e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1557 microversion: 2.1 time: 0.172977 Apr 01 10:14:19.696045 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 439/868] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:14:19 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:19.714489 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e22c07a2-0ce2-44e2-9872-d5199a09312e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:19.715080 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e22c07a2-0ce2-44e2-9872-d5199a09312e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:19.721837 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e22c07a2-0ce2-44e2-9872-d5199a09312e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:19.722279 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e22c07a2-0ce2-44e2-9872-d5199a09312e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:19.723110 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e22c07a2-0ce2-44e2-9872-d5199a09312e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:19.723534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e22c07a2-0ce2-44e2-9872-d5199a09312e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:19.811477 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e22c07a2-0ce2-44e2-9872-d5199a09312e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100954 Apr 01 10:14:19.812336 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 430/869] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:14:19 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:14:21.053107 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-b4ad9590-64eb-469b-bbb2-3a28aaa6d6d3 req-726dcbd0-270c-40ad-9fe1-528cba10520f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "faab71c0-1bab-48db-9b41-e6e8c908ea57", "tag": "7c832b8f-5482-4867-93bb-63c19a50ffba"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:21.061827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-b4ad9590-64eb-469b-bbb2-3a28aaa6d6d3 req-726dcbd0-270c-40ad-9fe1-528cba10520f service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:21.062260 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-b4ad9590-64eb-469b-bbb2-3a28aaa6d6d3 req-726dcbd0-270c-40ad-9fe1-528cba10520f service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:21.075911 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-b4ad9590-64eb-469b-bbb2-3a28aaa6d6d3 req-726dcbd0-270c-40ad-9fe1-528cba10520f service nova] Creating event network-changed:7c832b8f-5482-4867-93bb-63c19a50ffba for instance faab71c0-1bab-48db-9b41-e6e8c908ea57 on hv-cinder-maste Apr 01 10:14:21.081222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-b4ad9590-64eb-469b-bbb2-3a28aaa6d6d3 req-726dcbd0-270c-40ad-9fe1-528cba10520f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031880 Apr 01 10:14:21.081798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 440/870] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:14:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:14:41.835289 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d3bf2d9f-c997-4721-ab7a-156aaae6567d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:41.836214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d3bf2d9f-c997-4721-ab7a-156aaae6567d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:41.842896 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3bf2d9f-c997-4721-ab7a-156aaae6567d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:41.843339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3bf2d9f-c997-4721-ab7a-156aaae6567d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:41.844110 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3bf2d9f-c997-4721-ab7a-156aaae6567d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:41.844534 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d3bf2d9f-c997-4721-ab7a-156aaae6567d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:41.873776 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d3bf2d9f-c997-4721-ab7a-156aaae6567d tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043443 Apr 01 10:14:41.874315 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 431/871] 10.222.0.46 () {60 vars in 1342 bytes} [Fri Apr 1 10:14:41 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:14:41.933990 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:41.934523 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:41.941680 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:41.942121 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:41.942939 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:41.943372 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:41.967025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:14:42.045874 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3d51917e-1c99-4bf3-bf90-6fa2b6cde24f tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 204 len: 0 microversion: 2.20 time: 0.116927 Apr 01 10:14:42.046365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 441/872] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 1 10:14:41 2022] DELETE /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 01 10:14:42.054849 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:42.055449 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:42.061499 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:42.061951 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:42.062769 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:42.063206 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:42.203403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:42.211701 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:42.213235 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:42.214408 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3556f25e-e5da-4737-a4d0-3b08b40c7cc3 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.163624 Apr 01 10:14:42.215028 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 432/873] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:14:42 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 01 10:14:43.237526 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:43.238493 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:43.247950 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:43.248595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:43.249696 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:43.250289 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:43.396443 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:43.404484 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:43.405977 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:43.407206 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e81cbde5-83b5-4f30-ad99-0cd996337fb8 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1723 microversion: 2.20 time: 0.175914 Apr 01 10:14:43.407755 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 442/874] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:14:43 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:14:44.425854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:44.426495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:44.432898 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:44.433405 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:44.434215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:44.434658 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:44.542035 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:44.550202 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:44.551637 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'a0661916b4064097a834dcef7e02b3ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '984d4a492510482d88f7aec954117969', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:14:44.552793 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ddbc59e1-278d-4846-9101-21e008faaf06 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 200 len: 1655 microversion: 2.20 time: 0.131118 Apr 01 10:14:44.553345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 433/875] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:14:44 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 1655 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 01 10:14:44.982715 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-87a51416-511f-4a2f-ad8f-b97b827a0335 req-7eb22be5-e974-47a6-9aad-cb15cfaa1fd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b6b5d9e-6bee-443c-86e3-94e71c99643d", "name": "network-vif-deleted", "tag": "29223cc6-236b-47ca-8914-e65111046089"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:44.991967 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-87a51416-511f-4a2f-ad8f-b97b827a0335 req-7eb22be5-e974-47a6-9aad-cb15cfaa1fd7 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:44.992496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-87a51416-511f-4a2f-ad8f-b97b827a0335 req-7eb22be5-e974-47a6-9aad-cb15cfaa1fd7 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:45.005003 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-87a51416-511f-4a2f-ad8f-b97b827a0335 req-7eb22be5-e974-47a6-9aad-cb15cfaa1fd7 service nova] Creating event network-vif-deleted:29223cc6-236b-47ca-8914-e65111046089 for instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d on hv-cinder-maste Apr 01 10:14:45.009949 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-87a51416-511f-4a2f-ad8f-b97b827a0335 req-7eb22be5-e974-47a6-9aad-cb15cfaa1fd7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237679 Apr 01 10:14:45.010554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 443/876] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:14:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:14:45.571503 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:45.572132 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:45.578829 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:45.579280 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:45.580042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:45.580471 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:45.594860 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] HTTP exception thrown: Instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d could not be found. Apr 01 10:14:45.595454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Returning 404 to user: Instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:45.596310 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-38df3b23-1472-46ef-917b-264b00831065 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 404 len: 111 microversion: 2.20 time: 0.028832 Apr 01 10:14:45.596874 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 434/877] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:14:45 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:14:45.606201 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-02b4d3b0-8303-440f-ac59-11ba9a24a666 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '.version_select at 0x7f64ee659f70>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:45.629718 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-02b4d3b0-8303-440f-ac59-11ba9a24a666 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752989184" status: 204 len: 0 microversion: 2.20 time: 0.027724 Apr 01 10:14:45.630551 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 444/878] 10.222.0.46 () {60 vars in 1261 bytes} [Fri Apr 1 10:14:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1752989184 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 01 10:14:47.417342 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:47.418172 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:47.425099 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:47.425559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:47.426336 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:47.426810 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:47.440440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] HTTP exception thrown: Instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d could not be found. Apr 01 10:14:47.441021 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Returning 404 to user: Instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:47.441844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-de228b4d-c90b-4891-987e-5fbdd50473bc tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 404 len: 111 microversion: 2.20 time: 0.029887 Apr 01 10:14:47.442328 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 435/879] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 1 10:14:47 2022] DELETE /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:14:47.451348 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:47.452103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: 5b6b5d9e-6bee-443c-86e3-94e71c99643d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:47.458762 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:47.459221 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:47.460015 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:47.460445 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:47.474581 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] HTTP exception thrown: Instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d could not be found. Apr 01 10:14:47.475228 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Returning 404 to user: Instance 5b6b5d9e-6bee-443c-86e3-94e71c99643d could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:47.476077 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a0b26533-037d-4e14-a73c-c184a894b82e tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d" status: 404 len: 111 microversion: 2.20 time: 0.029455 Apr 01 10:14:47.476948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 445/880] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:14:47 2022] GET /compute/v2.1/servers/5b6b5d9e-6bee-443c-86e3-94e71c99643d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:14:48.630007 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:48.630560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:48.638343 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:48.638937 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:48.639829 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:48.640378 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:48.654609 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] HTTP exception thrown: Instance f0c911a2-ef42-4d2a-bea9-a6c56575559f could not be found. Apr 01 10:14:48.655232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Returning 404 to user: Instance f0c911a2-ef42-4d2a-bea9-a6c56575559f could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:48.656056 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-29a11932-b5c5-4386-aea3-8365b50a3e00 tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 404 len: 111 microversion: 2.20 time: 0.030357 Apr 01 10:14:48.656671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 436/881] 10.222.0.46 () {60 vars in 1279 bytes} [Fri Apr 1 10:14:48 2022] DELETE /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:14:48.664914 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:48.665957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] [instance: f0c911a2-ef42-4d2a-bea9-a6c56575559f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:14:48.671723 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:48.672171 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:48.672932 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:14:48.673361 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:14:48.686474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] HTTP exception thrown: Instance f0c911a2-ef42-4d2a-bea9-a6c56575559f could not be found. Apr 01 10:14:48.687077 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] Returning 404 to user: Instance f0c911a2-ef42-4d2a-bea9-a6c56575559f could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:48.687879 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-52bbf876-d010-4480-8715-79f5990dbb6a tempest-AttachVolumeShelveTestJSON-1338508774 tempest-AttachVolumeShelveTestJSON-1338508774-project] 10.222.0.46 "GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f" status: 404 len: 111 microversion: 2.20 time: 0.027012 Apr 01 10:14:48.688393 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 446/882] 10.222.0.46 () {60 vars in 1276 bytes} [Fri Apr 1 10:14:48 2022] GET /compute/v2.1/servers/f0c911a2-ef42-4d2a-bea9-a6c56575559f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 01 10:14:53.246903 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-908d9b48-c332-429a-be46-12c8c9155060 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Action: 'create', calling method: .version_select at 0x7f64ed7f5820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-604666580", "metadata": {"Type": "work"}}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:53.248385 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-908d9b48-c332-429a-be46-12c8c9155060 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:53.249205 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-908d9b48-c332-429a-be46-12c8c9155060 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.116068 Apr 01 10:14:53.249722 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 437/883] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 1 10:14:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 117 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:14:53.258961 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-68815f7a-4c5c-457e-be39-4b66a87a9d9f tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Action: 'create', calling method: .version_select at 0x7f64edb50e50>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1943279432", "metadata": {"Type": "work"}}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:53.260380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-68815f7a-4c5c-457e-be39-4b66a87a9d9f tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:53.261182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-68815f7a-4c5c-457e-be39-4b66a87a9d9f tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.006227 Apr 01 10:14:53.261668 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 447/884] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 1 10:14:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 01 10:14:53.270122 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2626773a-781c-4ae7-8d9b-bfe5f45e2dd7 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Action: 'create', calling method: .version_select at 0x7f64ee501b80>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-851681305", "metadata": {"Type": "work"}}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:14:53.272096 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2626773a-781c-4ae7-8d9b-bfe5f45e2dd7 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:53.272880 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2626773a-781c-4ae7-8d9b-bfe5f45e2dd7 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006560 Apr 01 10:14:53.273377 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 438/885] 10.222.0.46 () {60 vars in 1155 bytes} [Fri Apr 1 10:14:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 8 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 01 10:14:53.282015 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4c2412bc-b0d7-435f-86b5-c7ea3cf486f3 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Calling method '.version_select at 0x7f64edb3f040>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:53.309907 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-4c2412bc-b0d7-435f-86b5-c7ea3cf486f3 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] HTTP exception thrown: Volume tempest-invalid-1015286512 could not be found. Apr 01 10:14:53.310495 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4c2412bc-b0d7-435f-86b5-c7ea3cf486f3 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Returning 404 to user: Volume tempest-invalid-1015286512 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:53.311362 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4c2412bc-b0d7-435f-86b5-c7ea3cf486f3 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1015286512" status: 404 len: 99 microversion: 2.1 time: 0.033410 Apr 01 10:14:53.311897 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 448/886] 10.222.0.46 () {58 vars in 1217 bytes} [Fri Apr 1 10:14:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1015286512 => generated 99 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Apr 01 10:14:53.321006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a933efa5-d9d2-4fc4-86c4-015df2409aed tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003800 Apr 01 10:14:53.321492 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 439/887] 10.222.0.46 () {58 vars in 1139 bytes} [Fri Apr 1 10:14:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 01 10:14:53.330914 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-075d5d16-4ec1-45b4-9bac-0482a028fe8e tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003618 Apr 01 10:14:53.331387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 449/888] 10.222.0.46 () {58 vars in 1136 bytes} [Fri Apr 1 10:14:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Apr 01 10:14:53.341097 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-91a5d659-30de-49e2-aa99-3296b1d36c44 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Calling method '.version_select at 0x7f64ed9aeca0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:53.369191 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-91a5d659-30de-49e2-aa99-3296b1d36c44 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] HTTP exception thrown: Volume c340923b-a5d2-423e-81aa-c29df73fbb4e could not be found. Apr 01 10:14:53.369787 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-91a5d659-30de-49e2-aa99-3296b1d36c44 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Returning 404 to user: Volume c340923b-a5d2-423e-81aa-c29df73fbb4e could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:53.370613 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-91a5d659-30de-49e2-aa99-3296b1d36c44 tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/c340923b-a5d2-423e-81aa-c29df73fbb4e" status: 404 len: 109 microversion: 2.1 time: 0.033098 Apr 01 10:14:53.371188 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 440/889] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:14:53 2022] DELETE /compute/v2.1/os-volumes/c340923b-a5d2-423e-81aa-c29df73fbb4e => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:14:53.380363 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1787323d-baa0-4985-b098-0e872b3a404b tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Calling method '.version_select at 0x7f64edae1160>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:14:53.407817 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-1787323d-baa0-4985-b098-0e872b3a404b tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] HTTP exception thrown: Volume 4c895c27-3fe7-4221-8100-0c3a9f4c4234 could not be found. Apr 01 10:14:53.408406 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1787323d-baa0-4985-b098-0e872b3a404b tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] Returning 404 to user: Volume 4c895c27-3fe7-4221-8100-0c3a9f4c4234 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:14:53.409221 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1787323d-baa0-4985-b098-0e872b3a404b tempest-VolumesNegativeTest-1031005946 tempest-VolumesNegativeTest-1031005946-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/4c895c27-3fe7-4221-8100-0c3a9f4c4234" status: 404 len: 109 microversion: 2.1 time: 0.032729 Apr 01 10:14:53.409764 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 450/890] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:14:53 2022] GET /compute/v2.1/os-volumes/4c895c27-3fe7-4221-8100-0c3a9f4c4234 => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 01 10:16:00.249702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d043b8c3-3ae1-49aa-bdea-780bee154bda tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:00.250763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d043b8c3-3ae1-49aa-bdea-780bee154bda tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:00.261061 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d043b8c3-3ae1-49aa-bdea-780bee154bda tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:00.261807 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d043b8c3-3ae1-49aa-bdea-780bee154bda tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:00.263137 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d043b8c3-3ae1-49aa-bdea-780bee154bda tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:00.263869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d043b8c3-3ae1-49aa-bdea-780bee154bda tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:00.287937 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d043b8c3-3ae1-49aa-bdea-780bee154bda tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/ips" status: 200 len: 151 microversion: 2.1 time: 0.048499 Apr 01 10:16:00.288504 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 441/891] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:16:00 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/ips => generated 151 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:16:01.641647 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0c97c357-c495-4279-b8c6-3907e5bbe90c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc3da2e-cf80-4d7e-b3ae-1ed9a3a1b7dd"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:16:01.642726 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0c97c357-c495-4279-b8c6-3907e5bbe90c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:01.649869 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c97c357-c495-4279-b8c6-3907e5bbe90c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:01.650359 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c97c357-c495-4279-b8c6-3907e5bbe90c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:01.651246 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c97c357-c495-4279-b8c6-3907e5bbe90c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:01.651689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0c97c357-c495-4279-b8c6-3907e5bbe90c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:01.903377 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0c97c357-c495-4279-b8c6-3907e5bbe90c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268232 Apr 01 10:16:01.903984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 451/892] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:16:01 2022] POST /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:16:02.917247 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:16:02.918103 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:16:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:16:09.443478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3f47be05-3c85-4ed3-a809-a54f48634746 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: .version_select at 0x7f64eda41a60>, body: {"keypair": {"name": "tempest-keypair-1024270946"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:16:09.458905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-3f47be05-3c85-4ed3-a809-a54f48634746 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:16:09.463069 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-3f47be05-3c85-4ed3-a809-a54f48634746 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:16:09.536535 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-3f47be05-3c85-4ed3-a809-a54f48634746 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:16:09.540418 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-3f47be05-3c85-4ed3-a809-a54f48634746 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:16:09.552783 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3f47be05-3c85-4ed3-a809-a54f48634746 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.113301 Apr 01 10:16:09.553396 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 442/893] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:16:09 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:10.866364 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1802110017", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9da82d1d-4bc1-4295-8708-e98235a59efd"}], "security_groups": [{"name": "tempest-securitygroup--1282224741"}], "key_name": "tempest-keypair-1024270946", "user_data": "}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:16:10.969237 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] validate_networks() for [('9da82d1d-4bc1-4295-8708-e98235a59efd', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:16:11.454608 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:16:11.455144 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:16:11.455616 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:16:11.456028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:16:11.456432 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:16:11.466020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:11.466473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:11.467318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:11.467758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:11.485522 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:16:11.490148 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:16:11.502180 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:16:11.504618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:16:11.563057 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-52faefe5-a0e8-48cf-8f67-74ee4a98734a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.701414 Apr 01 10:16:11.564170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 452/894] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:16:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:16:11.582486 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-ba27a07a-5806-49e7-abdc-403f5b40a670 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:11.583637 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-ba27a07a-5806-49e7-abdc-403f5b40a670 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:11.652652 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-ba27a07a-5806-49e7-abdc-403f5b40a670 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:11.659850 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-ba27a07a-5806-49e7-abdc-403f5b40a670 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1242 microversion: 2.1 time: 0.085688 Apr 01 10:16:11.660533 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 443/895] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:11 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1242 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:12.679166 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:12.679827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:12.687578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:12.688031 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:12.688922 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:12.689478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:12.757387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:12.765994 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-85b57693-4482-4ede-8b4a-457ab3ddb410 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1302 microversion: 2.1 time: 0.092020 Apr 01 10:16:12.766684 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 453/896] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:12 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:13.784531 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:13.785189 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:13.792206 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:13.792718 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:13.793520 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:13.794045 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:14.020728 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:14.029419 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d4d4d32b-700e-4245-a428-5337e0f18bf2 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1368 microversion: 2.1 time: 0.248919 Apr 01 10:16:14.029986 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 444/897] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:13 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:14.109907 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-c11c9712-d109-4a14-8d89-9861de744b2f req-8cdd6aa5-b447-4968-8d71-301ceaf9617d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12010425-1723-422f-9232-4b5b3ba8fc06", "tag": "9178883a-4cf6-4bc4-84b1-d58256022746"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:16:14.123626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-c11c9712-d109-4a14-8d89-9861de744b2f req-8cdd6aa5-b447-4968-8d71-301ceaf9617d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:14.124046 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-c11c9712-d109-4a14-8d89-9861de744b2f req-8cdd6aa5-b447-4968-8d71-301ceaf9617d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:14.148719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-c11c9712-d109-4a14-8d89-9861de744b2f req-8cdd6aa5-b447-4968-8d71-301ceaf9617d service nova] Creating event network-changed:9178883a-4cf6-4bc4-84b1-d58256022746 for instance 12010425-1723-422f-9232-4b5b3ba8fc06 on hv-cinder-maste Apr 01 10:16:14.154198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-c11c9712-d109-4a14-8d89-9861de744b2f req-8cdd6aa5-b447-4968-8d71-301ceaf9617d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048202 Apr 01 10:16:14.155133 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 454/898] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:16:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:16:15.047074 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:15.048232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:15.055397 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:15.055907 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:15.056920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:15.057548 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:15.344370 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:15.354003 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-18f6f57d-cbac-46ec-9870-15fee8eb2af0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1368 microversion: 2.1 time: 0.310869 Apr 01 10:16:15.354682 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 445/899] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:15 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1368 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:16.376218 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:16.377328 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:16.385937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:16.386389 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:16.387209 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:16.387646 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:16.532737 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:16.540306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-94415df7-dde8-47d6-81bf-1ae9285901e6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1368 microversion: 2.1 time: 0.171195 Apr 01 10:16:16.540875 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 455/900] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:16 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:17.558266 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:17.558931 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:17.565886 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:17.566342 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:17.567194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:17.567632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:17.716794 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:17.724750 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-929a9605-b895-479e-b6f0-087f7a1b33c9 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1368 microversion: 2.1 time: 0.170669 Apr 01 10:16:17.725397 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 446/901] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:17 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:18.742042 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:18.742556 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:18.749122 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:18.749585 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:18.750356 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:18.750826 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:18.901920 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:18.913072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-4059799a-5e41-466c-a82b-7be3bd9c5f83 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1368 microversion: 2.1 time: 0.175035 Apr 01 10:16:18.913887 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 456/902] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:18 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:19.939806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:19.941021 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:19.955515 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:19.956084 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:19.957087 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:19.957595 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:20.089668 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:20.097412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-923e8f9e-5d74-4a28-9fdd-8d035d469140 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1368 microversion: 2.1 time: 0.164202 Apr 01 10:16:20.097988 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 447/903] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:19 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:20.303379 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-51242f0c-a64a-48e9-b41c-ee732f71a12c req-4a96e29d-c9da-4652-864e-37c70438507c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12010425-1723-422f-9232-4b5b3ba8fc06", "name": "network-vif-plugged", "status": "completed", "tag": "9178883a-4cf6-4bc4-84b1-d58256022746"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:16:20.311531 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-51242f0c-a64a-48e9-b41c-ee732f71a12c req-4a96e29d-c9da-4652-864e-37c70438507c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:20.311962 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-51242f0c-a64a-48e9-b41c-ee732f71a12c req-4a96e29d-c9da-4652-864e-37c70438507c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:20.322889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-51242f0c-a64a-48e9-b41c-ee732f71a12c req-4a96e29d-c9da-4652-864e-37c70438507c service nova] Creating event network-vif-plugged:9178883a-4cf6-4bc4-84b1-d58256022746 for instance 12010425-1723-422f-9232-4b5b3ba8fc06 on hv-cinder-maste Apr 01 10:16:20.327914 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-51242f0c-a64a-48e9-b41c-ee732f71a12c req-4a96e29d-c9da-4652-864e-37c70438507c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188827 Apr 01 10:16:20.328480 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 457/904] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:16:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:16:21.118405 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:21.119276 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:21.126693 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:21.127220 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:21.128071 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:21.128546 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:21.272042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:21.279869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-691ce40d-1a0d-4f45-9e7c-e406a839c72c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1368 microversion: 2.1 time: 0.168145 Apr 01 10:16:21.280412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 448/905] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:21 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1368 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:22.297666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:22.298474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:22.305577 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:22.306046 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:22.306882 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:22.307398 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:22.452239 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:16:22.460575 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7dbbc19b-6dcf-4663-9014-023183c679cf tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1559 microversion: 2.1 time: 0.167306 Apr 01 10:16:22.461187 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 458/906] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:16:22 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:16:22.477195 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-79811750-e861-4936-ab31-6a3e5c3b4656 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:16:22.477757 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-79811750-e861-4936-ab31-6a3e5c3b4656 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:16:22.484411 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79811750-e861-4936-ab31-6a3e5c3b4656 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:22.484923 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79811750-e861-4936-ab31-6a3e5c3b4656 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:22.485700 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79811750-e861-4936-ab31-6a3e5c3b4656 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:22.486135 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-79811750-e861-4936-ab31-6a3e5c3b4656 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:22.574916 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-79811750-e861-4936-ab31-6a3e5c3b4656 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101295 Apr 01 10:16:22.575805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 449/907] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:16:22 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:16:23.579957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-f761d52f-c931-4dad-a844-4fb2a6db49c0 req-a94c7fb6-cf6d-4ce1-9d09-f29f426d572b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12010425-1723-422f-9232-4b5b3ba8fc06", "tag": "9178883a-4cf6-4bc4-84b1-d58256022746"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:16:23.588689 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-f761d52f-c931-4dad-a844-4fb2a6db49c0 req-a94c7fb6-cf6d-4ce1-9d09-f29f426d572b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:16:23.589142 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-f761d52f-c931-4dad-a844-4fb2a6db49c0 req-a94c7fb6-cf6d-4ce1-9d09-f29f426d572b service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:16:23.611252 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-f761d52f-c931-4dad-a844-4fb2a6db49c0 req-a94c7fb6-cf6d-4ce1-9d09-f29f426d572b service nova] Creating event network-changed:9178883a-4cf6-4bc4-84b1-d58256022746 for instance 12010425-1723-422f-9232-4b5b3ba8fc06 on hv-cinder-maste Apr 01 10:16:23.616297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-f761d52f-c931-4dad-a844-4fb2a6db49c0 req-a94c7fb6-cf6d-4ce1-9d09-f29f426d572b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040168 Apr 01 10:16:23.617128 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 459/908] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:17:36.035458 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:17:36.036602 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:17:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:17:38.673211 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-84b38cae-e592-4787-b125-0a43b2300d72 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:38.673864 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-84b38cae-e592-4787-b125-0a43b2300d72 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:38.680432 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84b38cae-e592-4787-b125-0a43b2300d72 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.680884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84b38cae-e592-4787-b125-0a43b2300d72 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:38.681671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84b38cae-e592-4787-b125-0a43b2300d72 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.682121 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-84b38cae-e592-4787-b125-0a43b2300d72 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:38.705232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-84b38cae-e592-4787-b125-0a43b2300d72 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06/ips" status: 200 len: 151 microversion: 2.1 time: 0.037781 Apr 01 10:17:38.705797 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 450/909] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:17:38 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:17:38.718281 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc3da2e-cf80-4d7e-b3ae-1ed9a3a1b7dd"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:17:38.719461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:38.726186 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.726637 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:38.727440 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.727872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:38.806554 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Invalid volume: volume 7dc3da2e-cf80-4d7e-b3ae-1ed9a3a1b7dd is already attached to instances: faab71c0-1bab-48db-9b41-e6e8c908ea57 Apr 01 10:17:38.807185 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 400 to user: Invalid volume: volume 7dc3da2e-cf80-4d7e-b3ae-1ed9a3a1b7dd is already attached to instances: faab71c0-1bab-48db-9b41-e6e8c908ea57 {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:17:38.808024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bea81e51-9eee-467c-ac71-466b08dbf56e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.095099 Apr 01 10:17:38.808580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 460/910] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:17:38 2022] POST /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:17:38.816816 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:38.817308 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:38.823296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.823746 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:38.824513 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.824938 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:38.848816 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:17:38.929740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b4ffab4b-6a48-4302-88da-7e2c5a059640 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 204 len: 0 microversion: 2.1 time: 0.116462 Apr 01 10:17:38.930404 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 451/911] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:17:38 2022] DELETE /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:17:38.939573 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:38.940200 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:38.946555 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.947041 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:38.947817 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:38.948245 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:39.093482 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:39.101618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8ad6533d-571a-4fd0-b338-5d7a280fe88d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1684 microversion: 2.1 time: 0.166445 Apr 01 10:17:39.102212 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 461/912] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:38 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:40.124045 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:40.125187 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:40.133255 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:40.133705 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:40.134480 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:40.134948 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:40.275037 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:40.283275 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-67dbb8c2-c222-4a6a-9af9-e9b9b9e133c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1684 microversion: 2.1 time: 0.166348 Apr 01 10:17:40.283838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 452/913] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:40 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1684 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:41.301091 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:41.301679 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:41.309043 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:41.309769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:41.310926 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:41.311203 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:41.376974 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:41.384792 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ff07876b-0cec-4c85-a6e0-533b8561aeb5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 200 len: 1616 microversion: 2.1 time: 0.087687 Apr 01 10:17:41.385366 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 462/914] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:41 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 1616 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:41.844571 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-1dc6e6fe-5984-4c91-b07a-6275216e6424 req-a44a0b37-2e85-4607-b129-628ceb11a40f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12010425-1723-422f-9232-4b5b3ba8fc06", "name": "network-vif-deleted", "tag": "9178883a-4cf6-4bc4-84b1-d58256022746"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:17:41.853759 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-1dc6e6fe-5984-4c91-b07a-6275216e6424 req-a44a0b37-2e85-4607-b129-628ceb11a40f service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:41.854227 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-1dc6e6fe-5984-4c91-b07a-6275216e6424 req-a44a0b37-2e85-4607-b129-628ceb11a40f service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:41.865966 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-1dc6e6fe-5984-4c91-b07a-6275216e6424 req-a44a0b37-2e85-4607-b129-628ceb11a40f service nova] Creating event network-vif-deleted:9178883a-4cf6-4bc4-84b1-d58256022746 for instance 12010425-1723-422f-9232-4b5b3ba8fc06 on hv-cinder-maste Apr 01 10:17:41.871153 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-1dc6e6fe-5984-4c91-b07a-6275216e6424 req-a44a0b37-2e85-4607-b129-628ceb11a40f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031323 Apr 01 10:17:41.871751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 453/915] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:17:42.402129 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:42.402902 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:42.409320 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:42.409709 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:42.410536 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:42.411002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:42.424412 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 12010425-1723-422f-9232-4b5b3ba8fc06 could not be found. Apr 01 10:17:42.425041 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 12010425-1723-422f-9232-4b5b3ba8fc06 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:17:42.425936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6e6dddde-a6dd-4922-9b28-7957a4f0f298 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 404 len: 111 microversion: 2.1 time: 0.027803 Apr 01 10:17:42.426471 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 463/916] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:42 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:17:42.435602 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-dba4b9ce-2b16-4c0a-8195-97d5708ab1e4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '.version_select at 0x7f64ed97e790>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:42.454285 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-dba4b9ce-2b16-4c0a-8195-97d5708ab1e4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024270946" status: 202 len: 0 microversion: 2.1 time: 0.022872 Apr 01 10:17:42.454926 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 454/917] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Apr 1 10:17:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1024270946 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:17:43.116767 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:43.117256 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:43.123661 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:43.124108 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:43.124872 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:43.125297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:43.202050 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lazy-loading 'services' on Instance uuid faab71c0-1bab-48db-9b41-e6e8c908ea57 {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:17:43.279649 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2a1cbf19-749c-4463-8ef2-a30ed2af7375 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments/7dc3da2e-cf80-4d7e-b3ae-1ed9a3a1b7dd" status: 202 len: 0 microversion: 2.1 time: 0.166692 Apr 01 10:17:43.280484 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 464/918] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:17:43 2022] DELETE /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments/7dc3da2e-cf80-4d7e-b3ae-1ed9a3a1b7dd => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:17:43.289395 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-185a18c5-c9ad-400f-b9ad-e6eac702171e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:43.290454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-185a18c5-c9ad-400f-b9ad-e6eac702171e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:43.297981 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-185a18c5-c9ad-400f-b9ad-e6eac702171e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:43.298674 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-185a18c5-c9ad-400f-b9ad-e6eac702171e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:43.299507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-185a18c5-c9ad-400f-b9ad-e6eac702171e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:43.299953 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-185a18c5-c9ad-400f-b9ad-e6eac702171e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:43.329567 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-185a18c5-c9ad-400f-b9ad-e6eac702171e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044562 Apr 01 10:17:43.330114 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 455/919] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:17:43 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:17:44.349519 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8cf9ac8c-2213-4382-ad2d-4d1564b6e20c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:44.350590 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8cf9ac8c-2213-4382-ad2d-4d1564b6e20c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:44.357213 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8cf9ac8c-2213-4382-ad2d-4d1564b6e20c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:44.357714 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8cf9ac8c-2213-4382-ad2d-4d1564b6e20c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:44.358509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8cf9ac8c-2213-4382-ad2d-4d1564b6e20c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:44.358982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8cf9ac8c-2213-4382-ad2d-4d1564b6e20c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:44.388495 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8cf9ac8c-2213-4382-ad2d-4d1564b6e20c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046697 Apr 01 10:17:44.389058 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 465/920] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:17:44 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:17:44.454265 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:44.454899 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:44.460949 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:44.461403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:44.462166 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:44.462599 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:44.486822 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:17:44.564845 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-94e472ef-f31f-4d5c-a656-44cb9dd8f532 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 204 len: 0 microversion: 2.1 time: 0.114346 Apr 01 10:17:44.565413 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 456/921] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:17:44 2022] DELETE /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:17:44.573592 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:44.574201 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:44.580387 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:44.580840 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:44.581607 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:44.582043 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:44.720764 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:44.728505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-719b7806-ddd2-4135-8359-ab9108563a5c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1682 microversion: 2.1 time: 0.158751 Apr 01 10:17:44.729069 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 466/922] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:44 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:45.756266 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:45.757009 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:45.767267 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:45.767852 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:45.769015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:45.769703 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:45.922721 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:45.930738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0dd002b9-a9ec-4725-b12f-3aa0015d1b53 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1682 microversion: 2.1 time: 0.186964 Apr 01 10:17:45.931334 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 457/923] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:45 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1682 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:46.951445 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:46.952008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:46.958921 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:46.959370 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:46.960143 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:46.960573 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:47.021756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:47.029297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-25eaaa73-1d4b-4139-aa24-61020326e7e1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 200 len: 1614 microversion: 2.1 time: 0.081824 Apr 01 10:17:47.029878 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 467/924] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:46 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 1614 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:47.180723 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-e216600f-903d-438b-8a45-695f237877b4 req-ae395f36-5114-418c-b71f-d05e0125685d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "faab71c0-1bab-48db-9b41-e6e8c908ea57", "name": "network-vif-deleted", "tag": "7c832b8f-5482-4867-93bb-63c19a50ffba"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:17:47.189389 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-e216600f-903d-438b-8a45-695f237877b4 req-ae395f36-5114-418c-b71f-d05e0125685d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:47.190921 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-e216600f-903d-438b-8a45-695f237877b4 req-ae395f36-5114-418c-b71f-d05e0125685d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:47.202879 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-e216600f-903d-438b-8a45-695f237877b4 req-ae395f36-5114-418c-b71f-d05e0125685d service nova] Creating event network-vif-deleted:7c832b8f-5482-4867-93bb-63c19a50ffba for instance faab71c0-1bab-48db-9b41-e6e8c908ea57 on hv-cinder-maste Apr 01 10:17:47.208075 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-e216600f-903d-438b-8a45-695f237877b4 req-ae395f36-5114-418c-b71f-d05e0125685d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031082 Apr 01 10:17:47.208686 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 458/925] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:17:48.048780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:48.049400 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:48.055999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:48.056454 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:48.057261 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:48.058370 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:48.072470 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance faab71c0-1bab-48db-9b41-e6e8c908ea57 could not be found. Apr 01 10:17:48.073093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance faab71c0-1bab-48db-9b41-e6e8c908ea57 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:17:48.073931 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c7c4beaf-7458-4576-ae97-e6239e271ed6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 404 len: 111 microversion: 2.1 time: 0.029620 Apr 01 10:17:48.074460 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 468/926] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:48 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 01 10:17:48.083751 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-30894327-2922-4972-8850-845d9a461148 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '.version_select at 0x7f64ee476160>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:48.103139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-30894327-2922-4972-8850-845d9a461148 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96812753" status: 202 len: 0 microversion: 2.1 time: 0.023479 Apr 01 10:17:48.103884 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 459/927] 10.222.0.46 () {58 vars in 1214 bytes} [Fri Apr 1 10:17:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96812753 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:17:48.727638 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-869363f3-a3c0-4058-88f2-876b55897110 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: .version_select at 0x7f64edbcc160>, body: {"keypair": {"name": "tempest-keypair-1508202344"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:17:48.741968 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-869363f3-a3c0-4058-88f2-876b55897110 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:17:48.745930 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-869363f3-a3c0-4058-88f2-876b55897110 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:17:48.817112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-869363f3-a3c0-4058-88f2-876b55897110 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:17:48.820898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-869363f3-a3c0-4058-88f2-876b55897110 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:17:48.833756 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-869363f3-a3c0-4058-88f2-876b55897110 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.110103 Apr 01 10:17:48.834344 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 469/928] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:17:48 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:50.077184 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1767978881", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9da82d1d-4bc1-4295-8708-e98235a59efd"}], "security_groups": [{"name": "tempest-securitygroup--788662780"}], "key_name": "tempest-keypair-1508202344", "user_data": "}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:17:50.186402 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] validate_networks() for [('9da82d1d-4bc1-4295-8708-e98235a59efd', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:17:50.575936 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:17:50.576586 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:17:50.577318 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:17:50.577952 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:17:50.578583 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:17:50.592895 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:50.593563 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:50.594796 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:50.595450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:50.612622 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:17:50.616828 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:17:50.627856 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:17:50.630208 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:17:50.681485 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-bb7b5c61-a0c4-4b15-8397-abbe62d75935 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.609033 Apr 01 10:17:50.682335 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 460/929] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:17:50 2022] POST /compute/v2.1/servers => generated 401 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:17:50.692941 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8688f1a6-5876-461c-9e5e-c8a52cfbd449 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:50.693566 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8688f1a6-5876-461c-9e5e-c8a52cfbd449 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:50.747300 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8688f1a6-5876-461c-9e5e-c8a52cfbd449 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:50.754623 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8688f1a6-5876-461c-9e5e-c8a52cfbd449 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1242 microversion: 2.1 time: 0.066095 Apr 01 10:17:50.755435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 470/930] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:50 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:51.772243 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:51.772852 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:51.779778 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:51.780297 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:51.781075 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:51.781504 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:51.850592 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:51.858098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4f92f3b6-1c3b-4874-b7fc-6f3bad1df33c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1300 microversion: 2.1 time: 0.090208 Apr 01 10:17:51.858672 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 461/931] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:51 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1300 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:52.875719 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:52.876410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:52.882539 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:52.883021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:52.883796 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:52.884234 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:52.947537 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-600b63a0-d2cd-4101-9411-75026fe89895 req-98598ca2-c266-4f8e-9715-9322cbf71d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99690bfd-08ec-4cda-afad-74c3c041bb6f", "tag": "c415f6d8-7767-472f-82aa-87971560171b"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:17:52.960388 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-600b63a0-d2cd-4101-9411-75026fe89895 req-98598ca2-c266-4f8e-9715-9322cbf71d87 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:52.961626 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-600b63a0-d2cd-4101-9411-75026fe89895 req-98598ca2-c266-4f8e-9715-9322cbf71d87 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:52.988867 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-600b63a0-d2cd-4101-9411-75026fe89895 req-98598ca2-c266-4f8e-9715-9322cbf71d87 service nova] Creating event network-changed:c415f6d8-7767-472f-82aa-87971560171b for instance 99690bfd-08ec-4cda-afad-74c3c041bb6f on hv-cinder-maste Apr 01 10:17:52.996146 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-600b63a0-d2cd-4101-9411-75026fe89895 req-98598ca2-c266-4f8e-9715-9322cbf71d87 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053105 Apr 01 10:17:52.997271 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 462/932] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:17:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:17:53.042749 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:53.050634 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e00ed774-d405-4f75-9871-e1c5ab619048 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1367 microversion: 2.1 time: 0.179149 Apr 01 10:17:53.054700 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 471/933] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:52 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:54.073407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:54.074513 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:54.084992 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:54.085734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:54.087063 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:54.087773 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:54.226586 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:54.234435 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-61dc6372-466a-4503-b4d0-36740a4aec75 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1367 microversion: 2.1 time: 0.168852 Apr 01 10:17:54.235034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 463/934] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:54 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:55.255557 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:55.256614 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:55.267774 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:55.268526 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:55.269695 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:55.270132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:55.404224 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:55.411942 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0b4a180d-b0bb-432b-8212-524b39af2039 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1367 microversion: 2.1 time: 0.162939 Apr 01 10:17:55.412509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 472/935] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:55 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:56.429169 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:56.429737 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:56.436490 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:56.436999 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:56.437784 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:56.438218 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:56.575822 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:56.583442 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b4a5ce39-a90d-40b2-b99d-953f4a471a90 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1367 microversion: 2.1 time: 0.158186 Apr 01 10:17:56.584018 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 464/936] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:56 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:57.603936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:57.604956 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:57.614681 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:57.615151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:57.615933 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:57.616364 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:57.754906 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:57.762561 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2946215f-74de-4aae-a577-b716b9a18a79 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1367 microversion: 2.1 time: 0.165393 Apr 01 10:17:57.763191 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 473/937] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:57 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:58.538581 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-0b11b8cb-ec47-4198-adc4-9e52668cda86 req-35f0f8f8-5e93-4017-804a-d974097d3e3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99690bfd-08ec-4cda-afad-74c3c041bb6f", "name": "network-vif-plugged", "status": "completed", "tag": "c415f6d8-7767-472f-82aa-87971560171b"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:17:58.547353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-0b11b8cb-ec47-4198-adc4-9e52668cda86 req-35f0f8f8-5e93-4017-804a-d974097d3e3d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:58.547826 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-0b11b8cb-ec47-4198-adc4-9e52668cda86 req-35f0f8f8-5e93-4017-804a-d974097d3e3d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:58.559172 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-0b11b8cb-ec47-4198-adc4-9e52668cda86 req-35f0f8f8-5e93-4017-804a-d974097d3e3d service nova] Creating event network-vif-plugged:c415f6d8-7767-472f-82aa-87971560171b for instance 99690bfd-08ec-4cda-afad-74c3c041bb6f on hv-cinder-maste Apr 01 10:17:58.564200 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-0b11b8cb-ec47-4198-adc4-9e52668cda86 req-35f0f8f8-5e93-4017-804a-d974097d3e3d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029464 Apr 01 10:17:58.564828 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 465/938] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:17:58.779843 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:58.780417 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:58.787270 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:58.788008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:58.788752 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:58.789300 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:58.920609 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:17:58.928783 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d176e7bb-525e-4fa0-b298-6d024eabbc8a tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1367 microversion: 2.1 time: 0.152881 Apr 01 10:17:58.929354 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 474/939] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:58 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:17:59.946466 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:17:59.947213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:17:59.955234 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:59.955678 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:17:59.956461 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:17:59.956888 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:18:00.102183 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:18:00.110831 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-087b35e8-1f24-4033-aa26-f1f78e09c9a4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1367 microversion: 2.1 time: 0.168854 Apr 01 10:18:00.111392 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 466/940] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:17:59 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:18:01.131991 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:18:01.132933 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:18:01.143977 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:18:01.144716 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:18:01.145971 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:18:01.146560 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:18:01.283562 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:18:01.291096 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6598d20d-0d5f-4b17-8ae5-e207ea404a38 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1557 microversion: 2.1 time: 0.165572 Apr 01 10:18:01.291675 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 475/941] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:18:01 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1557 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:18:01.307734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-bee92864-ee93-418f-bee1-1280d70c366b tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:18:01.308245 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-bee92864-ee93-418f-bee1-1280d70c366b tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:18:01.315177 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bee92864-ee93-418f-bee1-1280d70c366b tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:18:01.315632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bee92864-ee93-418f-bee1-1280d70c366b tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:18:01.316440 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bee92864-ee93-418f-bee1-1280d70c366b tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:18:01.316872 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bee92864-ee93-418f-bee1-1280d70c366b tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:18:01.400804 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-bee92864-ee93-418f-bee1-1280d70c366b tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096941 Apr 01 10:18:01.401462 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 467/942] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:18:01 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:18:02.644908 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-85239429-50fa-4219-a2ca-4e28af3943d2 req-47653d48-151c-4f96-b64c-ee1093988d4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99690bfd-08ec-4cda-afad-74c3c041bb6f", "tag": "c415f6d8-7767-472f-82aa-87971560171b"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:18:02.653524 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-85239429-50fa-4219-a2ca-4e28af3943d2 req-47653d48-151c-4f96-b64c-ee1093988d4c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:18:02.653959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-85239429-50fa-4219-a2ca-4e28af3943d2 req-47653d48-151c-4f96-b64c-ee1093988d4c service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:18:02.667241 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-85239429-50fa-4219-a2ca-4e28af3943d2 req-47653d48-151c-4f96-b64c-ee1093988d4c service nova] Creating event network-changed:c415f6d8-7767-472f-82aa-87971560171b for instance 99690bfd-08ec-4cda-afad-74c3c041bb6f on hv-cinder-maste Apr 01 10:18:02.672395 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-85239429-50fa-4219-a2ca-4e28af3943d2 req-47653d48-151c-4f96-b64c-ee1093988d4c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031471 Apr 01 10:18:02.673335 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 476/943] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:18:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:05.934916 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:19:05.936123 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:19:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:19:07.619905 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-78668410-74df-45ad-8a0e-767c99b28ac0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:07.620473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-78668410-74df-45ad-8a0e-767c99b28ac0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:07.626937 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-78668410-74df-45ad-8a0e-767c99b28ac0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:07.627395 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-78668410-74df-45ad-8a0e-767c99b28ac0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:07.628176 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-78668410-74df-45ad-8a0e-767c99b28ac0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:07.628612 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-78668410-74df-45ad-8a0e-767c99b28ac0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:07.651901 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-78668410-74df-45ad-8a0e-767c99b28ac0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/ips" status: 200 len: 150 microversion: 2.1 time: 0.127187 Apr 01 10:19:07.652457 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 468/944] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:19:07 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/ips => generated 150 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:08.983338 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c7d535fc-bae5-4605-bdc1-cec740575ee4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5751eab4-dd7a-4f6c-b32d-69974bb9f68e"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:08.984472 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c7d535fc-bae5-4605-bdc1-cec740575ee4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:08.990844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7d535fc-bae5-4605-bdc1-cec740575ee4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:08.991299 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7d535fc-bae5-4605-bdc1-cec740575ee4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:08.992062 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7d535fc-bae5-4605-bdc1-cec740575ee4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:08.992494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c7d535fc-bae5-4605-bdc1-cec740575ee4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:09.368345 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c7d535fc-bae5-4605-bdc1-cec740575ee4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.390406 Apr 01 10:19:09.368864 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 477/945] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:19:08 2022] POST /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments => generated 194 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:16.905841 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5751eab4-dd7a-4f6c-b32d-69974bb9f68e"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:16.906940 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:16.913318 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:16.913774 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:16.914537 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:16.915008 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:17.063352 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Invalid volume: volume 5751eab4-dd7a-4f6c-b32d-69974bb9f68e is already attached to instances: 99690bfd-08ec-4cda-afad-74c3c041bb6f Apr 01 10:19:17.063958 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 400 to user: Invalid volume: volume 5751eab4-dd7a-4f6c-b32d-69974bb9f68e is already attached to instances: 99690bfd-08ec-4cda-afad-74c3c041bb6f {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:19:17.064810 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f4d6f45d-56e3-450f-8dba-2854e47031dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.163236 Apr 01 10:19:17.065367 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 469/946] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:19:16 2022] POST /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments => generated 174 bytes in 164 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 01 10:19:17.128848 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:17.129396 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:17.138548 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:17.139025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:17.139786 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:17.140219 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:17.221812 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lazy-loading 'services' on Instance uuid 99690bfd-08ec-4cda-afad-74c3c041bb6f {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:19:17.300103 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6b67e3e5-ccd2-4f61-a6be-ffa52fd3fe86 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments/5751eab4-dd7a-4f6c-b32d-69974bb9f68e" status: 202 len: 0 microversion: 2.1 time: 0.178829 Apr 01 10:19:17.300619 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 478/947] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:19:17 2022] DELETE /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments/5751eab4-dd7a-4f6c-b32d-69974bb9f68e => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:19:17.309339 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6acfe6d5-c7fa-42dd-bf1c-cae7bb6cba05 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:17.310699 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6acfe6d5-c7fa-42dd-bf1c-cae7bb6cba05 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:17.319412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6acfe6d5-c7fa-42dd-bf1c-cae7bb6cba05 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:17.319867 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6acfe6d5-c7fa-42dd-bf1c-cae7bb6cba05 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:17.320618 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6acfe6d5-c7fa-42dd-bf1c-cae7bb6cba05 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:17.321073 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6acfe6d5-c7fa-42dd-bf1c-cae7bb6cba05 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:17.350328 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6acfe6d5-c7fa-42dd-bf1c-cae7bb6cba05 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Apr 01 10:19:17.350934 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 470/948] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:19:17 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:18.362827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-481b3e34-7522-44d1-ac20-4d42d182359d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:18.363884 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-481b3e34-7522-44d1-ac20-4d42d182359d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:18.370477 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-481b3e34-7522-44d1-ac20-4d42d182359d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:18.370953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-481b3e34-7522-44d1-ac20-4d42d182359d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:18.371813 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-481b3e34-7522-44d1-ac20-4d42d182359d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:18.372257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-481b3e34-7522-44d1-ac20-4d42d182359d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:18.401364 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-481b3e34-7522-44d1-ac20-4d42d182359d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043412 Apr 01 10:19:18.401905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 479/949] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:19:18 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:19:18.459056 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:18.459566 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:18.466239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:18.466685 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:18.467568 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:18.468009 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:18.492463 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:19:18.573458 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-1acb2efa-2929-4c59-8c3d-925acde536ae tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 204 len: 0 microversion: 2.1 time: 0.117973 Apr 01 10:19:18.574044 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 471/950] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:19:18 2022] DELETE /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:19:18.582510 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:18.583153 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:18.589072 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:18.589532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:18.590302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:18.590846 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:18.741929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:18.749995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-aed26abb-eab5-4e92-b41b-4ee0c3c810e7 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1682 microversion: 2.1 time: 0.171394 Apr 01 10:19:18.750609 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 480/951] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:18 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1682 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:19:19.773478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:19.774528 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:19.783869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:19.784325 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:19.785111 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:19.785537 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:19.927996 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:19.935922 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-af1b3b79-4be9-42c7-8a24-49a51c58563c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1682 microversion: 2.1 time: 0.170211 Apr 01 10:19:19.936478 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 472/952] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:19 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:20.953884 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:20.954453 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:20.961420 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:20.961870 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:20.962637 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:20.963095 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:21.103889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:21.113636 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-7e1373ed-be29-49f2-b0a6-6088cb232e52 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 200 len: 1682 microversion: 2.1 time: 0.163879 Apr 01 10:19:21.115397 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 481/953] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:20 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 1682 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:21.397241 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-3bc34688-2500-4fe6-838b-6f5d49f76095 req-295650be-e614-46da-b8e4-60ab176eba3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99690bfd-08ec-4cda-afad-74c3c041bb6f", "name": "network-vif-deleted", "tag": "c415f6d8-7767-472f-82aa-87971560171b"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:21.405764 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-3bc34688-2500-4fe6-838b-6f5d49f76095 req-295650be-e614-46da-b8e4-60ab176eba3e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:21.406215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-3bc34688-2500-4fe6-838b-6f5d49f76095 req-295650be-e614-46da-b8e4-60ab176eba3e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:21.418738 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-3bc34688-2500-4fe6-838b-6f5d49f76095 req-295650be-e614-46da-b8e4-60ab176eba3e service nova] Creating event network-vif-deleted:c415f6d8-7767-472f-82aa-87971560171b for instance 99690bfd-08ec-4cda-afad-74c3c041bb6f on hv-cinder-maste Apr 01 10:19:21.424532 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-3bc34688-2500-4fe6-838b-6f5d49f76095 req-295650be-e614-46da-b8e4-60ab176eba3e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030817 Apr 01 10:19:21.425120 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 473/954] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:19:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:22.131254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:22.131863 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:22.138460 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:22.139164 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:22.139788 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:22.140271 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:22.155949 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 99690bfd-08ec-4cda-afad-74c3c041bb6f could not be found. Apr 01 10:19:22.156540 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 99690bfd-08ec-4cda-afad-74c3c041bb6f could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:19:22.157366 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-180af56a-1714-4c6c-93e9-0054dfddb5f6 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 404 len: 111 microversion: 2.1 time: 0.030119 Apr 01 10:19:22.157922 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 482/955] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:22 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:19:22.167163 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-917ea576-31c4-45b9-9cf2-1cbfc38d2ec8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '.version_select at 0x7f64ee373700>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:22.187696 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-917ea576-31c4-45b9-9cf2-1cbfc38d2ec8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508202344" status: 202 len: 0 microversion: 2.1 time: 0.024761 Apr 01 10:19:22.188553 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 474/956] 10.222.0.46 () {58 vars in 1220 bytes} [Fri Apr 1 10:19:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1508202344 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:19:22.799542 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-40dde6fb-6cd2-4fc1-bda1-e3084b6f5677 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: .version_select at 0x7f64edb3fe50>, body: {"keypair": {"name": "tempest-keypair-36809934"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:22.814433 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-40dde6fb-6cd2-4fc1-bda1-e3084b6f5677 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:19:22.818286 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-40dde6fb-6cd2-4fc1-bda1-e3084b6f5677 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:19:22.987609 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-40dde6fb-6cd2-4fc1-bda1-e3084b6f5677 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:19:22.991724 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-40dde6fb-6cd2-4fc1-bda1-e3084b6f5677 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'key_pairs'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:19:23.005150 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-40dde6fb-6cd2-4fc1-bda1-e3084b6f5677 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2299 microversion: 2.1 time: 0.209643 Apr 01 10:19:23.005737 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 483/957] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:19:22 2022] POST /compute/v2.1/os-keypairs => generated 2299 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:24.294924 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-517905835", "imageRef": "42688686-abb8-4669-b0a5-386fa1673cb4", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9da82d1d-4bc1-4295-8708-e98235a59efd"}], "security_groups": [{"name": "tempest-securitygroup--1338112069"}], "key_name": "tempest-keypair-36809934", "user_data": "}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:24.401593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] validate_networks() for [('9da82d1d-4bc1-4295-8708-e98235a59efd', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:19:24.874204 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:19:24.875053 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:19:24.875736 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:19:24.876316 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:19:24.876871 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:19:24.890547 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:24.891024 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:24.892165 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:24.892590 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:24.909222 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:19:24.913218 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Getting quotas for user dc4e99689ba54f67bce199ca2779c331 and project 1e8c16b8e2564e468f11fb0bfdade484. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:19:24.924388 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:19:24.926694 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='42688686-abb8-4669-b0a5-386fa1673cb4',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:19:24.981130 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cd588e16-54d5-4c55-bc62-e77f35da2e4e tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.691981 Apr 01 10:19:24.982030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 475/958] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:19:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 694 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:19:24.992735 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-91b9dd69-7bd6-46bb-aba6-99efed295698 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:24.993495 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-91b9dd69-7bd6-46bb-aba6-99efed295698 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:25.047730 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-91b9dd69-7bd6-46bb-aba6-99efed295698 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:25.055317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-91b9dd69-7bd6-46bb-aba6-99efed295698 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1239 microversion: 2.1 time: 0.067029 Apr 01 10:19:25.055842 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 484/959] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:24 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1239 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:26.074005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:26.074616 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:26.081935 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:26.082606 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:26.083565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:26.083993 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:26.161625 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:26.169304 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8eb6a985-322e-41c4-b535-3d563458b2d8 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1297 microversion: 2.1 time: 0.100223 Apr 01 10:19:26.169851 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 476/960] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:26 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:27.187779 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:27.189123 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:27.196565 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:27.197222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:27.198340 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:27.198917 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:27.343880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:27.352039 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f533871e-5db8-481b-9cb5-9df25663055f tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1365 microversion: 2.1 time: 0.169074 Apr 01 10:19:27.352770 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 485/961] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:27 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:27.518740 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-b9232879-e129-4df2-8a33-9a96caf1bd42 req-7f3df318-53f7-40b5-b22b-0fb653949014 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8184c85d-e3ab-42a8-9032-56e90545b582", "tag": "714d39f9-1c38-49e3-af31-a70515b6e09d"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:27.528228 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-b9232879-e129-4df2-8a33-9a96caf1bd42 req-7f3df318-53f7-40b5-b22b-0fb653949014 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:27.528659 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-b9232879-e129-4df2-8a33-9a96caf1bd42 req-7f3df318-53f7-40b5-b22b-0fb653949014 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:27.545075 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-b9232879-e129-4df2-8a33-9a96caf1bd42 req-7f3df318-53f7-40b5-b22b-0fb653949014 service nova] Creating event network-changed:714d39f9-1c38-49e3-af31-a70515b6e09d for instance 8184c85d-e3ab-42a8-9032-56e90545b582 on hv-cinder-maste Apr 01 10:19:27.550633 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-b9232879-e129-4df2-8a33-9a96caf1bd42 req-7f3df318-53f7-40b5-b22b-0fb653949014 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036266 Apr 01 10:19:27.551324 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 477/962] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:28.369478 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:28.370102 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:28.377169 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:28.377619 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:28.378407 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:28.378907 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:28.515532 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:28.523509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5becb0ae-93b6-42ae-93f9-a164690ad043 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1365 microversion: 2.1 time: 0.158023 Apr 01 10:19:28.524080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 486/963] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:28 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:29.546605 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:29.547806 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:29.558817 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:29.559577 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:29.560919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:29.561641 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:29.704005 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:29.716066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c569229a-3cf2-43d4-b669-8c77dca4a8cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1365 microversion: 2.1 time: 0.177281 Apr 01 10:19:29.716878 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 478/964] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:29 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1365 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:30.737964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:30.739158 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:30.750177 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:30.750880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:30.752170 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:30.753123 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:30.898949 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:30.906657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-dbef5968-deb1-4fdf-9c1f-0a76c9b38281 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1365 microversion: 2.1 time: 0.175189 Apr 01 10:19:30.907240 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 487/965] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:30 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:31.927632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:31.928647 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:31.939403 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:31.939858 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:31.940628 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:31.941062 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:32.085446 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:32.096974 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4f539301-2d16-4fb4-aee3-cafa5a98a3dc tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1365 microversion: 2.1 time: 0.175548 Apr 01 10:19:32.097669 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 479/966] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:31 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1365 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:33.031147 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-0696f23e-b3e8-4489-8ae2-7698dd861562 req-25aaa12e-0e3f-4334-aa69-ec9fe3bbf61a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8184c85d-e3ab-42a8-9032-56e90545b582", "name": "network-vif-plugged", "status": "completed", "tag": "714d39f9-1c38-49e3-af31-a70515b6e09d"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:33.039735 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-0696f23e-b3e8-4489-8ae2-7698dd861562 req-25aaa12e-0e3f-4334-aa69-ec9fe3bbf61a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:33.040182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-0696f23e-b3e8-4489-8ae2-7698dd861562 req-25aaa12e-0e3f-4334-aa69-ec9fe3bbf61a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:33.051364 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-0696f23e-b3e8-4489-8ae2-7698dd861562 req-25aaa12e-0e3f-4334-aa69-ec9fe3bbf61a service nova] Creating event network-vif-plugged:714d39f9-1c38-49e3-af31-a70515b6e09d for instance 8184c85d-e3ab-42a8-9032-56e90545b582 on hv-cinder-maste Apr 01 10:19:33.056499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-0696f23e-b3e8-4489-8ae2-7698dd861562 req-25aaa12e-0e3f-4334-aa69-ec9fe3bbf61a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029160 Apr 01 10:19:33.057106 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 488/967] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:19:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:33.119507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:33.120207 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:33.127516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:33.127969 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:33.128761 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:33.129210 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:33.313811 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:33.321782 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8a4522ee-ed3e-4c0f-a017-7e346a181e19 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1365 microversion: 2.1 time: 0.206583 Apr 01 10:19:33.322376 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 480/968] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:33 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:34.340220 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:34.340900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:34.347623 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:34.348073 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:34.348853 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:34.349288 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:34.494063 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:34.501563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b9f1fc39-87fe-42e9-822d-d3be655764f1 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1365 microversion: 2.1 time: 0.166246 Apr 01 10:19:34.502124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 489/969] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:34 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:35.519408 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:35.520024 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:35.526915 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:35.527367 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:35.528146 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:35.528581 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:35.666876 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:19:35.676366 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2ff7e04d-b3a7-44f2-b624-8253467883ab tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1556 microversion: 2.1 time: 0.161341 Apr 01 10:19:35.676939 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 481/970] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:19:35 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1556 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:19:35.692953 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-14e7b7ef-1b8b-4507-a490-30798f1f84c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:19:35.693461 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-14e7b7ef-1b8b-4507-a490-30798f1f84c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:19:35.700254 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-14e7b7ef-1b8b-4507-a490-30798f1f84c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:35.700698 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-14e7b7ef-1b8b-4507-a490-30798f1f84c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:35.701474 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-14e7b7ef-1b8b-4507-a490-30798f1f84c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:35.701911 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-14e7b7ef-1b8b-4507-a490-30798f1f84c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:35.785957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-14e7b7ef-1b8b-4507-a490-30798f1f84c5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096980 Apr 01 10:19:35.786564 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 490/971] 10.222.0.46 () {58 vars in 1274 bytes} [Fri Apr 1 10:19:35 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:19:37.078262 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-dfa3ac0b-925b-40d7-bd24-e2aa98260321 req-ab8a1b22-30fe-4963-9690-30e8082000e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8184c85d-e3ab-42a8-9032-56e90545b582", "tag": "714d39f9-1c38-49e3-af31-a70515b6e09d"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:19:37.090272 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-dfa3ac0b-925b-40d7-bd24-e2aa98260321 req-ab8a1b22-30fe-4963-9690-30e8082000e0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:19:37.090746 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-dfa3ac0b-925b-40d7-bd24-e2aa98260321 req-ab8a1b22-30fe-4963-9690-30e8082000e0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:19:37.102221 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-dfa3ac0b-925b-40d7-bd24-e2aa98260321 req-ab8a1b22-30fe-4963-9690-30e8082000e0 service nova] Creating event network-changed:714d39f9-1c38-49e3-af31-a70515b6e09d for instance 8184c85d-e3ab-42a8-9032-56e90545b582 on hv-cinder-maste Apr 01 10:19:37.107614 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-dfa3ac0b-925b-40d7-bd24-e2aa98260321 req-ab8a1b22-30fe-4963-9690-30e8082000e0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099397 Apr 01 10:19:37.108272 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 482/972] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:19:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:20:41.915836 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b1a76b88-c3cf-45d2-827a-0a3da63997d5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:41.916856 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b1a76b88-c3cf-45d2-827a-0a3da63997d5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:41.925490 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b1a76b88-c3cf-45d2-827a-0a3da63997d5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:41.925943 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b1a76b88-c3cf-45d2-827a-0a3da63997d5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:41.926745 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b1a76b88-c3cf-45d2-827a-0a3da63997d5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:41.927180 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b1a76b88-c3cf-45d2-827a-0a3da63997d5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:41.951526 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b1a76b88-c3cf-45d2-827a-0a3da63997d5 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/ips" status: 200 len: 151 microversion: 2.1 time: 0.044578 Apr 01 10:20:41.952089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 491/973] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:20:41 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/ips => generated 151 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:20:43.288582 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-165823b8-8106-4ca6-910c-e50e056a4062 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a27a1d9b-0819-4e99-9336-f6f584f48877"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:20:43.290025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-165823b8-8106-4ca6-910c-e50e056a4062 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:43.299022 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-165823b8-8106-4ca6-910c-e50e056a4062 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:43.299470 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-165823b8-8106-4ca6-910c-e50e056a4062 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:43.300232 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-165823b8-8106-4ca6-910c-e50e056a4062 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:43.300659 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-165823b8-8106-4ca6-910c-e50e056a4062 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:43.555123 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-165823b8-8106-4ca6-910c-e50e056a4062 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "POST /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274947 Apr 01 10:20:43.555737 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 483/974] 10.222.0.46 () {60 vars in 1322 bytes} [Fri Apr 1 10:20:43 2022] POST /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments => generated 194 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:20:51.183548 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:51.184110 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:51.190482 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:51.190964 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:51.191805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:51.192243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:51.277324 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.objects.instance [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lazy-loading 'services' on Instance uuid 8184c85d-e3ab-42a8-9032-56e90545b582 {{(pid=117065) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Apr 01 10:20:51.359266 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b716e7e2-a757-4206-b9c0-07b3bb39b5e0 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments/a27a1d9b-0819-4e99-9336-f6f584f48877" status: 202 len: 0 microversion: 2.1 time: 0.179292 Apr 01 10:20:51.360104 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 492/975] 10.222.0.46 () {58 vars in 1415 bytes} [Fri Apr 1 10:20:51 2022] DELETE /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments/a27a1d9b-0819-4e99-9336-f6f584f48877 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:20:51.371013 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4b2381a3-faec-4c57-887e-9b0ed4e08cfd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:51.372023 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4b2381a3-faec-4c57-887e-9b0ed4e08cfd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:51.379274 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4b2381a3-faec-4c57-887e-9b0ed4e08cfd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:51.379724 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4b2381a3-faec-4c57-887e-9b0ed4e08cfd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:51.380501 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4b2381a3-faec-4c57-887e-9b0ed4e08cfd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:51.380928 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4b2381a3-faec-4c57-887e-9b0ed4e08cfd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:51.413007 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4b2381a3-faec-4c57-887e-9b0ed4e08cfd tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046766 Apr 01 10:20:51.413495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 484/976] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:20:51 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:20:52.429118 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6bef975f-0b45-480b-afbc-e49debba2daa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:52.430207 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6bef975f-0b45-480b-afbc-e49debba2daa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:52.437438 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bef975f-0b45-480b-afbc-e49debba2daa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:52.437898 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bef975f-0b45-480b-afbc-e49debba2daa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:52.438714 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bef975f-0b45-480b-afbc-e49debba2daa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:52.439154 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6bef975f-0b45-480b-afbc-e49debba2daa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:52.468497 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6bef975f-0b45-480b-afbc-e49debba2daa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046330 Apr 01 10:20:52.469100 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 493/977] 10.222.0.46 () {58 vars in 1301 bytes} [Fri Apr 1 10:20:52 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 01 10:20:52.528038 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:52.528560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:52.535253 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:52.535704 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:52.536451 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:52.536901 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:52.562433 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Going to try to terminate instance {{(pid=117066) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:20:52.648660 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-43d57ac6-29a8-4329-b207-a7f49715d0cb tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 204 len: 0 microversion: 2.1 time: 0.124358 Apr 01 10:20:52.649243 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 485/978] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:20:52 2022] DELETE /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:20:52.657648 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:52.658269 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:52.664357 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:52.664835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:52.665618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:52.666032 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:52.805210 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:20:52.812920 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-09603590-9614-4031-bdeb-59be9d386521 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1681 microversion: 2.1 time: 0.159197 Apr 01 10:20:52.813487 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 494/979] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:20:52 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:20:53.834941 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:53.835516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:53.842214 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:53.842680 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:53.843446 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:53.843895 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:53.984212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:20:53.995298 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-8be1e005-3af0-48fc-bb4d-cffe4f31e6d4 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1681 microversion: 2.1 time: 0.167649 Apr 01 10:20:53.995846 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 486/980] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:20:53 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:20:55.013124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:55.013992 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:55.023153 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:55.023806 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:55.024988 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:55.025613 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:55.169033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dc4e99689ba54f67bce199ca2779c331', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8c16b8e2564e468f11fb0bfdade484', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:20:55.176917 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d4a2aafa-22d3-4c14-ad9a-b3ede9a12552 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 200 len: 1681 microversion: 2.1 time: 0.167813 Apr 01 10:20:55.177500 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 495/981] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:20:55 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:20:55.513845 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-2fc1bc5a-6dd6-4bee-8b58-9926f08c926d req-467a6fc1-2a87-4b16-aafc-64d12e71d760 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8184c85d-e3ab-42a8-9032-56e90545b582", "name": "network-vif-deleted", "tag": "714d39f9-1c38-49e3-af31-a70515b6e09d"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:20:55.522008 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-2fc1bc5a-6dd6-4bee-8b58-9926f08c926d req-467a6fc1-2a87-4b16-aafc-64d12e71d760 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:55.522708 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-2fc1bc5a-6dd6-4bee-8b58-9926f08c926d req-467a6fc1-2a87-4b16-aafc-64d12e71d760 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:55.537412 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-2fc1bc5a-6dd6-4bee-8b58-9926f08c926d req-467a6fc1-2a87-4b16-aafc-64d12e71d760 service nova] Creating event network-vif-deleted:714d39f9-1c38-49e3-af31-a70515b6e09d for instance 8184c85d-e3ab-42a8-9032-56e90545b582 on hv-cinder-maste Apr 01 10:20:55.544071 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-2fc1bc5a-6dd6-4bee-8b58-9926f08c926d req-467a6fc1-2a87-4b16-aafc-64d12e71d760 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100429 Apr 01 10:20:55.544685 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 487/982] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:20:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:20:56.193654 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:56.194264 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:56.201192 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:56.201655 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:56.202432 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:56.202911 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:56.216578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 8184c85d-e3ab-42a8-9032-56e90545b582 could not be found. Apr 01 10:20:56.217185 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 8184c85d-e3ab-42a8-9032-56e90545b582 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:20:56.218019 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-b98d9d1f-9cca-4cc2-addf-88d695c25f9c tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 404 len: 111 microversion: 2.1 time: 0.028351 Apr 01 10:20:56.218880 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 496/983] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:20:56 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:20:56.227748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5a776f66-241e-45f7-976b-0c32b688e62d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '.version_select at 0x7f64eda41940>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:56.249079 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5a776f66-241e-45f7-976b-0c32b688e62d tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-36809934" status: 202 len: 0 microversion: 2.1 time: 0.025462 Apr 01 10:20:56.249680 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 488/984] 10.222.0.46 () {58 vars in 1214 bytes} [Fri Apr 1 10:20:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-36809934 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:20:58.051296 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:58.051808 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:58.058780 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:58.059236 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:58.060008 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:58.060420 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:58.074985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 8184c85d-e3ab-42a8-9032-56e90545b582 could not be found. Apr 01 10:20:58.075577 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 8184c85d-e3ab-42a8-9032-56e90545b582 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:20:58.076399 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9aefc062-d1a2-423a-b505-46bad5749c39 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 404 len: 111 microversion: 2.1 time: 0.029055 Apr 01 10:20:58.076940 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 497/985] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:20:58 2022] DELETE /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:20:58.085246 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:58.085981 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 8184c85d-e3ab-42a8-9032-56e90545b582] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:58.093030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:58.093473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:58.094238 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:58.094683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:58.108149 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 8184c85d-e3ab-42a8-9032-56e90545b582 could not be found. Apr 01 10:20:58.108872 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 8184c85d-e3ab-42a8-9032-56e90545b582 could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:20:58.109681 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-3ccad11f-bb4b-4788-bf9e-e830e20b4ada tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582" status: 404 len: 111 microversion: 2.1 time: 0.028536 Apr 01 10:20:58.110201 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 489/986] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:20:58 2022] GET /compute/v2.1/servers/8184c85d-e3ab-42a8-9032-56e90545b582 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:20:59.260152 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:59.260652 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:59.268024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.268473 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.269250 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.269688 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.283982 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 99690bfd-08ec-4cda-afad-74c3c041bb6f could not be found. Apr 01 10:20:59.284560 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 99690bfd-08ec-4cda-afad-74c3c041bb6f could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:20:59.285375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5c455eea-9360-4e95-8d6c-94170266c467 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 404 len: 111 microversion: 2.1 time: 0.031541 Apr 01 10:20:59.285893 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 498/987] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:20:59 2022] DELETE /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:20:59.294357 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:59.294998 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 99690bfd-08ec-4cda-afad-74c3c041bb6f] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:59.301956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.302410 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.303213 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.303642 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.317265 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 99690bfd-08ec-4cda-afad-74c3c041bb6f could not be found. Apr 01 10:20:59.317849 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 99690bfd-08ec-4cda-afad-74c3c041bb6f could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:20:59.318671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-22d3dc88-109d-463c-8cf6-70c928422826 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f" status: 404 len: 111 microversion: 2.1 time: 0.028635 Apr 01 10:20:59.319222 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 490/988] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:20:59 2022] GET /compute/v2.1/servers/99690bfd-08ec-4cda-afad-74c3c041bb6f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:20:59.327808 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:59.328301 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:59.335260 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.335703 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.336463 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.336892 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.350594 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 12010425-1723-422f-9232-4b5b3ba8fc06 could not be found. Apr 01 10:20:59.351218 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 12010425-1723-422f-9232-4b5b3ba8fc06 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:20:59.352032 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-93ee9379-aff7-40ce-9353-e9ed8a2e59fa tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 404 len: 111 microversion: 2.1 time: 0.028382 Apr 01 10:20:59.352583 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 499/989] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:20:59 2022] DELETE /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:20:59.362834 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:20:59.363573 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: 12010425-1723-422f-9232-4b5b3ba8fc06] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:20:59.372709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.373369 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.374526 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:20:59.375212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:20:59.392627 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance 12010425-1723-422f-9232-4b5b3ba8fc06 could not be found. Apr 01 10:20:59.393227 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance 12010425-1723-422f-9232-4b5b3ba8fc06 could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:20:59.394056 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-871bc289-da25-44c9-b50a-bee341a96c07 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06" status: 404 len: 111 microversion: 2.1 time: 0.037060 Apr 01 10:20:59.394599 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 491/990] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:20:59 2022] GET /compute/v2.1/servers/12010425-1723-422f-9232-4b5b3ba8fc06 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:21:00.531845 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:00.532365 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:21:00.539090 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:21:00.539538 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:21:00.540298 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:21:00.540731 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:21:00.554847 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance faab71c0-1bab-48db-9b41-e6e8c908ea57 could not be found. Apr 01 10:21:00.555426 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance faab71c0-1bab-48db-9b41-e6e8c908ea57 could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:21:00.556239 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-83184d52-acfc-4383-8a85-92586f382538 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "DELETE /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 404 len: 111 microversion: 2.1 time: 0.028354 Apr 01 10:21:00.556761 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 500/991] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:21:00 2022] DELETE /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:21:00.564903 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:00.565523 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] [instance: faab71c0-1bab-48db-9b41-e6e8c908ea57] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:21:00.572455 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:21:00.572915 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:21:00.573702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:21:00.574144 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:21:00.588178 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] HTTP exception thrown: Instance faab71c0-1bab-48db-9b41-e6e8c908ea57 could not be found. Apr 01 10:21:00.588758 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] Returning 404 to user: Instance faab71c0-1bab-48db-9b41-e6e8c908ea57 could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:21:00.589579 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-bd88a793-1c74-43d8-a689-0b3606395061 tempest-AttachVolumeNegativeTest-469042603 tempest-AttachVolumeNegativeTest-469042603-project] 10.222.0.46 "GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57" status: 404 len: 111 microversion: 2.1 time: 0.028565 Apr 01 10:21:00.590138 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 492/992] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:21:00 2022] GET /compute/v2.1/servers/faab71c0-1bab-48db-9b41-e6e8c908ea57 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:21:05.188849 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1f52e4c8-27a3-4e38-8c7b-0586b7d361d6 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Action: 'create', calling method: .version_select at 0x7f64edb2f8b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-735414641"}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:21:05.494243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1f52e4c8-27a3-4e38-8c7b-0586b7d361d6 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.434169 Apr 01 10:21:05.494360 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 501/993] 10.222.0.46 () {60 vars in 1154 bytes} [Fri Apr 1 10:21:05 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 436 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Apr 01 10:21:05.505559 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2af8006b-662e-4359-9783-70a9b51797f4 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ee4e9040>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:05.553648 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2af8006b-662e-4359-9783-70a9b51797f4 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d" status: 200 len: 344 microversion: 2.1 time: 0.052068 Apr 01 10:21:05.554221 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 493/994] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:21:05 2022] GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d => generated 344 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:06.570317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-674b263e-10b2-4f65-8c77-7fa3ec4e309c tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64edb953a0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:06.624366 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-674b263e-10b2-4f65-8c77-7fa3ec4e309c tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d" status: 200 len: 345 microversion: 2.1 time: 0.061377 Apr 01 10:21:06.624937 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 502/995] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:21:06 2022] GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d => generated 345 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:06.636514 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e7d4db39-65df-44e4-b259-201b93f7503a tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Action: 'create', calling method: .version_select at 0x7f64ef5b83a0>, body: {"snapshot": {"volume_id": "2fe68417-f95d-48b1-97f7-d67f773b236d", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2022054326"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:21:06.789897 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e7d4db39-65df-44e4-b259-201b93f7503a tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.157574 Apr 01 10:21:06.790565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 494/996] 10.222.0.46 () {60 vars in 1161 bytes} [Fri Apr 1 10:21:06 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:06.800892 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6c0bf7a8-9129-40e9-b824-5470e0976832 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64edb2ff70>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:06.828877 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6c0bf7a8-9129-40e9-b824-5470e0976832 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 200 len: 287 microversion: 2.1 time: 0.032246 Apr 01 10:21:06.829496 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 503/997] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:06 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:06.839369 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e2f364ea-64ba-41fa-a820-9ef93231d5ca tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ee3739d0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:06.867175 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e2f364ea-64ba-41fa-a820-9ef93231d5ca tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.031528 Apr 01 10:21:06.867893 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 495/998] 10.222.0.46 () {58 vars in 1139 bytes} [Fri Apr 1 10:21:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:06.878102 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8343114d-1280-4cec-bdb5-466d132c1ecb tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64edae1160>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:06.906343 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8343114d-1280-4cec-bdb5-466d132c1ecb tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 200 len: 287 microversion: 2.1 time: 0.032126 Apr 01 10:21:06.906989 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 504/999] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:06 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 287 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:07.922601 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5b1317e9-b52d-442e-945e-d347689f4943 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ed865790>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:07.955647 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5b1317e9-b52d-442e-945e-d347689f4943 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 200 len: 287 microversion: 2.1 time: 0.040295 Apr 01 10:21:07.956197 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 496/1000] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:07 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:08.972212 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bd4163b9-08c7-444c-939f-833042750849 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ee5158b0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:09.007494 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bd4163b9-08c7-444c-939f-833042750849 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 200 len: 287 microversion: 2.1 time: 0.042748 Apr 01 10:21:09.008059 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 505/1001] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:08 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:10.026882 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-08855536-a527-4e21-bd59-34f633aecdc7 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ef5b8dc0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:10.058127 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-08855536-a527-4e21-bd59-34f633aecdc7 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 200 len: 287 microversion: 2.1 time: 0.038606 Apr 01 10:21:10.058673 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 497/1002] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:10 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 287 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:11.074858 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5e69f4e9-6874-480b-ac24-76be5a570c29 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64edb2f820>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:11.105601 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5e69f4e9-6874-480b-ac24-76be5a570c29 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 200 len: 288 microversion: 2.1 time: 0.038523 Apr 01 10:21:11.106148 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 506/1003] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:11 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 288 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:11.117137 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4b15e4d4-6936-49d8-be12-a23dec43e086 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ed8650d0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:11.174602 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4b15e4d4-6936-49d8-be12-a23dec43e086 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 202 len: 0 microversion: 2.1 time: 0.061753 Apr 01 10:21:11.175300 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 498/1004] 10.222.0.46 () {58 vars in 1253 bytes} [Fri Apr 1 10:21:11 2022] DELETE /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:21:11.184265 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-a3e14383-59ab-4c74-b23e-31f537d67631 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64edbf1310>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:11.213198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-a3e14383-59ab-4c74-b23e-31f537d67631 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 200 len: 287 microversion: 2.1 time: 0.032784 Apr 01 10:21:11.213751 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 507/1005] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:11 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 287 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:12.228940 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4ffebe14-fd35-4a89-bc6b-bc3d9226bbcc tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ee4e9940>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:12.262321 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-4ffebe14-fd35-4a89-bc6b-bc3d9226bbcc tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] HTTP exception thrown: Snapshot 82e6cd88-47f7-4400-a01a-1caa5d064985 could not be found. Apr 01 10:21:12.263012 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4ffebe14-fd35-4a89-bc6b-bc3d9226bbcc tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Returning 404 to user: Snapshot 82e6cd88-47f7-4400-a01a-1caa5d064985 could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:21:12.263853 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4ffebe14-fd35-4a89-bc6b-bc3d9226bbcc tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985" status: 404 len: 111 microversion: 2.1 time: 0.042170 Apr 01 10:21:12.264411 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 499/1006] 10.222.0.46 () {58 vars in 1250 bytes} [Fri Apr 1 10:21:12 2022] GET /compute/v2.1/os-snapshots/82e6cd88-47f7-4400-a01a-1caa5d064985 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:21:12.273602 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2f09de77-4464-4af1-863e-beb32bc6d6d3 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64f2aaaaf0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:12.336786 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2f09de77-4464-4af1-863e-beb32bc6d6d3 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d" status: 202 len: 0 microversion: 2.1 time: 0.067351 Apr 01 10:21:12.337415 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 508/1007] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:21:12 2022] DELETE /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:21:12.346422 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-30aad6f1-6e16-43e8-b5f7-3328a4df8984 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ee373f70>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:12.394209 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-30aad6f1-6e16-43e8-b5f7-3328a4df8984 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d" status: 200 len: 344 microversion: 2.1 time: 0.051590 Apr 01 10:21:12.394827 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 500/1008] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:21:12 2022] GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:21:13.408319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d5efdbd6-9ac1-448b-b342-6f0e2e745479 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64edbf1c10>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:13.434977 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-d5efdbd6-9ac1-448b-b342-6f0e2e745479 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] HTTP exception thrown: Volume 2fe68417-f95d-48b1-97f7-d67f773b236d could not be found. Apr 01 10:21:13.435595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d5efdbd6-9ac1-448b-b342-6f0e2e745479 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Returning 404 to user: Volume 2fe68417-f95d-48b1-97f7-d67f773b236d could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:21:13.436413 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d5efdbd6-9ac1-448b-b342-6f0e2e745479 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d" status: 404 len: 109 microversion: 2.1 time: 0.032945 Apr 01 10:21:13.436957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 509/1009] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:21:13 2022] GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d => generated 109 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:21:13.451417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d9bac0fb-ee25-4eb7-9deb-56cbc745ab7e tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64ef5b8ee0>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:13.479290 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-d9bac0fb-ee25-4eb7-9deb-56cbc745ab7e tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] HTTP exception thrown: Volume 2fe68417-f95d-48b1-97f7-d67f773b236d could not be found. Apr 01 10:21:13.479891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d9bac0fb-ee25-4eb7-9deb-56cbc745ab7e tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Returning 404 to user: Volume 2fe68417-f95d-48b1-97f7-d67f773b236d could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:21:13.480708 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d9bac0fb-ee25-4eb7-9deb-56cbc745ab7e tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d" status: 404 len: 109 microversion: 2.1 time: 0.033797 Apr 01 10:21:13.481289 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 501/1010] 10.222.0.46 () {58 vars in 1247 bytes} [Fri Apr 1 10:21:13 2022] DELETE /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:21:13.489822 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-946c98fd-2152-4c1f-b841-d7629bd3d702 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Calling method '.version_select at 0x7f64edb2f8b0>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:21:13.517586 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-946c98fd-2152-4c1f-b841-d7629bd3d702 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] HTTP exception thrown: Volume 2fe68417-f95d-48b1-97f7-d67f773b236d could not be found. Apr 01 10:21:13.518172 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-946c98fd-2152-4c1f-b841-d7629bd3d702 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] Returning 404 to user: Volume 2fe68417-f95d-48b1-97f7-d67f773b236d could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:21:13.519080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-946c98fd-2152-4c1f-b841-d7629bd3d702 tempest-VolumesSnapshotsTestJSON-2106967476 tempest-VolumesSnapshotsTestJSON-2106967476-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d" status: 404 len: 109 microversion: 2.1 time: 0.033410 Apr 01 10:21:13.519633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 510/1011] 10.222.0.46 () {58 vars in 1244 bytes} [Fri Apr 1 10:21:13 2022] GET /compute/v2.1/os-volumes/2fe68417-f95d-48b1-97f7-d67f773b236d => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:22:07.463296 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-df27cdf7-ab63-4abb-8256-73997f0ba6fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Action: 'create', calling method: .version_select at 0x7f64ef651e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1093465623"}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:22:07.478042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-df27cdf7-ab63-4abb-8256-73997f0ba6fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for project 246bc36f10274d35821692e2c7fed45a. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:22:07.482011 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-df27cdf7-ab63-4abb-8256-73997f0ba6fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for user 3915ad324c4c4f1da32715584f8d9ca7 and project 246bc36f10274d35821692e2c7fed45a. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:22:07.850118 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-df27cdf7-ab63-4abb-8256-73997f0ba6fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for project 246bc36f10274d35821692e2c7fed45a. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:22:07.853926 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-df27cdf7-ab63-4abb-8256-73997f0ba6fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for user 3915ad324c4c4f1da32715584f8d9ca7 and project 246bc36f10274d35821692e2c7fed45a. Resources: {'key_pairs'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:22:07.868154 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-df27cdf7-ab63-4abb-8256-73997f0ba6fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.576486 Apr 01 10:22:07.868762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 502/1012] 10.222.0.46 () {60 vars in 1157 bytes} [Fri Apr 1 10:22:07 2022] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:25.948758 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:22:25.949713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:22:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:22:27.375723 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1832291013", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1093465623", "security_groups": [{"name": "tempest-secgroup-smoke-1720076103"}], "block_device_mapping_v2": [{"uuid": "2c4e4543-5004-4ac5-9fd7-8e605bf174b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2ea6cd2-7b6c-4468-8631-0d4f84d24ae3"}]}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:22:27.487080 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] validate_networks() for [('c2ea6cd2-7b6c-4468-8631-0d4f84d24ae3', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:22:27.945918 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:22:27.946363 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:22:27.946835 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:22:27.947240 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:22:27.947643 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:22:27.957306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:27.957770 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:27.958572 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:27.959041 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:27.976146 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for project 246bc36f10274d35821692e2c7fed45a. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:22:27.980319 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for user 3915ad324c4c4f1da32715584f8d9ca7 and project 246bc36f10274d35821692e2c7fed45a. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:22:28.036318 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:22:28.038471 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c4e4543-5004-4ac5-9fd7-8e605bf174b3',volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:22:28.175802 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-46041013-6f3f-4b6d-9080-4ccea0628c6f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.805284 Apr 01 10:22:28.176423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 511/1013] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:22:27 2022] POST /compute/v2.1/servers => generated 406 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:22:28.186515 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6c159575-4447-476f-bf11-c6fde35248ef tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:28.187160 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6c159575-4447-476f-bf11-c6fde35248ef tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:28.239319 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6c159575-4447-476f-bf11-c6fde35248ef tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:28.248391 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6c159575-4447-476f-bf11-c6fde35248ef tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1095 microversion: 2.1 time: 0.065734 Apr 01 10:22:28.249614 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 503/1014] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:28 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1095 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:29.265968 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:29.266984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:29.274875 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:29.275335 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:29.276120 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:29.276558 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:29.337132 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:29.345089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1fbcb20b-a266-4cd0-955f-fbc275f8e383 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1211 microversion: 2.1 time: 0.083533 Apr 01 10:22:29.345666 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 512/1015] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:29 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1211 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:30.361439 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:30.362656 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:30.369528 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:30.370060 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:30.371106 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:30.371758 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:30.496501 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-4dc4cdf8-8bdb-4b9c-a44a-de80ee3eb278 req-ff45d650-f83a-4b29-8f87-abeea564d768 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f8180a-a601-4ebb-a8b7-7be3e26a705d", "tag": "ec48ad7c-a555-4de8-b601-68be6497ba40"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:22:30.507205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-4dc4cdf8-8bdb-4b9c-a44a-de80ee3eb278 req-ff45d650-f83a-4b29-8f87-abeea564d768 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:30.507988 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-4dc4cdf8-8bdb-4b9c-a44a-de80ee3eb278 req-ff45d650-f83a-4b29-8f87-abeea564d768 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:30.521512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-4dc4cdf8-8bdb-4b9c-a44a-de80ee3eb278 req-ff45d650-f83a-4b29-8f87-abeea564d768 service nova] Creating event network-changed:ec48ad7c-a555-4de8-b601-68be6497ba40 for instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d on hv-cinder-maste Apr 01 10:22:30.527154 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-4dc4cdf8-8bdb-4b9c-a44a-de80ee3eb278 req-ff45d650-f83a-4b29-8f87-abeea564d768 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034389 Apr 01 10:22:30.527790 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 513/1016] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:22:30.619989 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:30.628682 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-a3f5f28d-31aa-40d6-ac0d-1ad5f6f42cf6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.271163 Apr 01 10:22:30.629265 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 504/1017] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:30 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:31.650426 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:31.651583 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:31.661317 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:31.662015 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:31.663199 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:31.663781 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:31.819716 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:31.827609 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-008e4331-5818-4f83-907f-262b3c720867 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.184458 Apr 01 10:22:31.828180 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 514/1018] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:31 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:32.849136 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:32.849994 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:32.860651 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:32.861408 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:32.862438 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:32.862920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:33.002565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:33.013854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-4bdfe926-6f17-4c7a-9207-b41de3ca184d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.171151 Apr 01 10:22:33.014671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 505/1019] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:32 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:34.034241 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:34.034947 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:34.042433 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:34.042929 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:34.043697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:34.044125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:34.191177 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:34.199114 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-65523b46-902d-4602-b0de-a9e90dbffd3d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.169212 Apr 01 10:22:34.199687 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 515/1020] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:34 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:35.216465 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:35.217065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:35.223859 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:35.224314 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:35.225147 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:35.225518 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:35.366048 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:35.374945 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6e2e938b-2440-4e55-ac55-a551cc5c178a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.162438 Apr 01 10:22:35.375582 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 506/1021] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:35 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:36.050290 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:22:36.051182 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:22:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:22:36.398105 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:36.398755 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:36.405698 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:36.406150 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:36.406975 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:36.407410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:36.546004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:36.553627 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-868ecd01-2ffc-4e38-bb93-92e85fb6de4e tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.161559 Apr 01 10:22:36.554198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 516/1022] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:36 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:37.574132 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:37.574940 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:37.583340 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:37.583910 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:37.584869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:37.585409 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:37.735578 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:37.743635 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2f8eb0bd-33db-4efb-b4be-393caaf78723 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.175242 Apr 01 10:22:37.744212 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 507/1023] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:37 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:22:38.765115 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:38.765984 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:38.776229 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:38.776687 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:38.777458 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:38.777892 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:38.917663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:38.925109 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3fc4505b-9b6a-4645-9f1e-9a83ff18dd52 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.166792 Apr 01 10:22:38.925667 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 517/1024] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:38 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:39.942233 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:39.942847 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:39.949621 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:39.950065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:39.950866 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:39.951294 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:40.091036 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:40.099556 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f5d38909-bcaf-4fc7-a44c-0ec3da2d7a25 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.161313 Apr 01 10:22:40.100112 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 508/1025] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:39 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:41.125621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:41.126635 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:41.137383 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:41.138135 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:41.139450 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:41.140166 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:41.281810 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:41.289423 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d2a6b466-65fd-4fbc-b74d-f3ea9f386295 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.170341 Apr 01 10:22:41.289988 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 518/1026] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:41 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:41.862479 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-4f3eb9fa-0edf-4d5d-b32a-750fe1ab5afb req-13313c5b-4c14-437c-984d-e2f09e420c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f8180a-a601-4ebb-a8b7-7be3e26a705d", "name": "network-vif-plugged", "status": "completed", "tag": "ec48ad7c-a555-4de8-b601-68be6497ba40"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:22:41.870711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-4f3eb9fa-0edf-4d5d-b32a-750fe1ab5afb req-13313c5b-4c14-437c-984d-e2f09e420c7d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:41.871117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-4f3eb9fa-0edf-4d5d-b32a-750fe1ab5afb req-13313c5b-4c14-437c-984d-e2f09e420c7d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:41.881769 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-4f3eb9fa-0edf-4d5d-b32a-750fe1ab5afb req-13313c5b-4c14-437c-984d-e2f09e420c7d service nova] Creating event network-vif-plugged:ec48ad7c-a555-4de8-b601-68be6497ba40 for instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d on hv-cinder-maste Apr 01 10:22:41.886974 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-4f3eb9fa-0edf-4d5d-b32a-750fe1ab5afb req-13313c5b-4c14-437c-984d-e2f09e420c7d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085111 Apr 01 10:22:41.887541 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 509/1027] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:22:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:22:42.309573 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:42.310157 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:42.316992 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:42.317438 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:42.318204 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:42.318633 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:42.459297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:42.467359 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-ea6d295a-d5a7-405d-bcd4-8d0eb23fc570 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1267 microversion: 2.1 time: 0.162244 Apr 01 10:22:42.468234 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 519/1028] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:42 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:42.933754 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:22:42.934734 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:22:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:22:43.485782 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:43.486553 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:43.493493 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:43.493951 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:43.494755 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:43.495190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:43.635683 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:43.644399 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d2276926-b01d-4f57-a4c5-536e2a7b83fa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1453 microversion: 2.1 time: 0.163397 Apr 01 10:22:43.645042 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 510/1029] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:43 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1453 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:43.660713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:22:43.661328 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:22:43.667946 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:43.668392 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:43.669164 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:43.669618 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:43.806680 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:22:43.815139 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-76a92292-79dd-485c-b792-61b8ecef27aa tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1453 microversion: 2.1 time: 0.158236 Apr 01 10:22:43.815713 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 520/1030] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:22:43 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:22:45.765777 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-b2a5734e-2e9d-4f3e-b411-5bc780cdb111 req-7c8ec49d-eb16-4853-9b31-7c3fbf6470c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f8180a-a601-4ebb-a8b7-7be3e26a705d", "tag": "ec48ad7c-a555-4de8-b601-68be6497ba40"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:22:45.774908 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-b2a5734e-2e9d-4f3e-b411-5bc780cdb111 req-7c8ec49d-eb16-4853-9b31-7c3fbf6470c2 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:22:45.775375 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-b2a5734e-2e9d-4f3e-b411-5bc780cdb111 req-7c8ec49d-eb16-4853-9b31-7c3fbf6470c2 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:22:45.785927 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-b2a5734e-2e9d-4f3e-b411-5bc780cdb111 req-7c8ec49d-eb16-4853-9b31-7c3fbf6470c2 service nova] Creating event network-changed:ec48ad7c-a555-4de8-b601-68be6497ba40 for instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d on hv-cinder-maste Apr 01 10:22:45.791217 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-b2a5734e-2e9d-4f3e-b411-5bc780cdb111 req-7c8ec49d-eb16-4853-9b31-7c3fbf6470c2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029011 Apr 01 10:22:45.791837 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 511/1031] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:24:50.299648 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:24:50.300786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:24:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:24:59.950059 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9936db0-33c7-44dd-9842-748b878c0c8e] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 01 10:24:59.953697 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:24:59.954192 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:24:59.960671 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:24:59.961125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:24:59.961928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:24:59.962360 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:24:59.986685 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:25:00.066138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-3bf7510c-8703-4be9-8f4c-3b73f516f7af tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "DELETE /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 204 len: 0 microversion: 2.1 time: 0.117966 Apr 01 10:25:00.066773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 521/1032] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:24:59 2022] DELETE /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 01 10:25:00.074451 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: ERROR oslo.messaging._drivers.impl_rabbit [-] [ad161493-1042-4e45-9820-69393cc3749f] AMQP server on 10.222.0.46:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 01 10:25:00.078560 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:00.079469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:00.085920 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:00.086364 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:00.087117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:00.087545 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:00.296506 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:00.305215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-0cbdb7f9-9d9d-4986-861b-8866ad665633 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1578 microversion: 2.1 time: 0.232787 Apr 01 10:25:00.305781 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 512/1033] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:00 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:01.327769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:01.328750 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:01.340351 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:01.341067 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:01.342376 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:01.343137 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:01.350025 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9936db0-33c7-44dd-9842-748b878c0c8e] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 58692. Apr 01 10:25:01.537482 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:01.545134 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-65b32a39-a0f5-4b38-b166-7bf36b6bdf30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1578 microversion: 2.1 time: 0.224693 Apr 01 10:25:01.545701 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 522/1034] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:01 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1578 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:02.563572 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:02.564190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:02.573589 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:02.574021 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:02.574897 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:02.575341 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:02.581843 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] [ad161493-1042-4e45-9820-69393cc3749f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 58700. Apr 01 10:25:02.687913 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:02.695994 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c8c501aa-9ad5-4a43-9f7e-16ae92062263 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 200 len: 1510 microversion: 2.1 time: 0.136522 Apr 01 10:25:02.696581 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 513/1035] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:02 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 1510 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:02.776490 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-30e57227-456f-4ce0-9938-15afb25813d8 req-81d49858-c08c-4af4-9015-adc9ab537d1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f8180a-a601-4ebb-a8b7-7be3e26a705d", "name": "network-vif-deleted", "tag": "ec48ad7c-a555-4de8-b601-68be6497ba40"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:25:02.785644 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-30e57227-456f-4ce0-9938-15afb25813d8 req-81d49858-c08c-4af4-9015-adc9ab537d1e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:02.786007 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-30e57227-456f-4ce0-9938-15afb25813d8 req-81d49858-c08c-4af4-9015-adc9ab537d1e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:02.800284 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-30e57227-456f-4ce0-9938-15afb25813d8 req-81d49858-c08c-4af4-9015-adc9ab537d1e service nova] Creating event network-vif-deleted:ec48ad7c-a555-4de8-b601-68be6497ba40 for instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d on hv-cinder-maste Apr 01 10:25:02.808613 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-30e57227-456f-4ce0-9938-15afb25813d8 req-81d49858-c08c-4af4-9015-adc9ab537d1e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035718 Apr 01 10:25:02.809651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 523/1036] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:25:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:25:03.713488 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:03.714107 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:03.720671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:03.721129 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:03.721891 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:03.722324 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:03.735636 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] HTTP exception thrown: Instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d could not be found. Apr 01 10:25:03.736244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Returning 404 to user: Instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:25:03.737066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cac9570a-f363-4f73-ae16-57326af3d1f1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 404 len: 111 microversion: 2.1 time: 0.027549 Apr 01 10:25:03.737632 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 514/1037] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:03 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:25:03.789331 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-953504475", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1093465623", "security_groups": [{"name": "tempest-secgroup-smoke-1720076103"}], "block_device_mapping_v2": [{"uuid": "2c4e4543-5004-4ac5-9fd7-8e605bf174b3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2ea6cd2-7b6c-4468-8631-0d4f84d24ae3"}]}} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:25:03.904712 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.network.neutron [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] validate_networks() for [('c2ea6cd2-7b6c-4468-8631-0d4f84d24ae3', None, None, None, None, None)] {{(pid=117065) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:25:04.285349 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Flavor limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:25:04.285774 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Image limits 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:25:04.286243 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Flavor pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:25:04.286692 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Image pref 0:0:0 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:25:04.287053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.virt.hardware [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117065) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:25:04.297210 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:04.297655 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:04.298449 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:04.298917 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:04.316302 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for project 246bc36f10274d35821692e2c7fed45a. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:25:04.320798 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.quota [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for user 3915ad324c4c4f1da32715584f8d9ca7 and project 246bc36f10274d35821692e2c7fed45a. Resources: {'cores', 'ram', 'instances'} {{(pid=117065) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:25:04.377889 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Going to run 1 instances... {{(pid=117065) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:25:04.380164 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c4e4543-5004-4ac5-9fd7-8e605bf174b3',volume_size=None,volume_type=None)] {{(pid=117065) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:25:04.507640 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9284a3a9-7ba4-4986-a1ba-83a3d20b93e1 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.722981 Apr 01 10:25:04.508325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 524/1038] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:25:03 2022] POST /compute/v2.1/servers => generated 406 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:25:04.519093 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-c7b54fdb-3220-417f-ae62-935e8ec69f8b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:04.519697 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-c7b54fdb-3220-417f-ae62-935e8ec69f8b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:04.573636 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-c7b54fdb-3220-417f-ae62-935e8ec69f8b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:04.580709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-c7b54fdb-3220-417f-ae62-935e8ec69f8b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1094 microversion: 2.1 time: 0.065940 Apr 01 10:25:04.581360 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 515/1039] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:04 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 01 10:25:05.599580 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:05.600535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:05.614764 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:05.615229 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:05.616684 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:05.619141 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:05.687503 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:05.695995 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6e5f8c96-7922-4b98-b461-be4a1cf06bbc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1210 microversion: 2.1 time: 0.102249 Apr 01 10:25:05.697081 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 525/1040] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:05 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1210 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:06.713445 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:06.714023 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:06.721533 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:06.721981 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:06.722910 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:06.723345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:06.827524 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-e2dec8bf-f894-4b65-936a-2e2871d6ddb3 req-c2e31fd5-2020-4914-ad0f-7817e6ebcd9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e30334-7ae4-4d34-8c40-c24c23b7c72e", "tag": "e9ea2a93-ce5d-4ee1-8b30-bec6d4315523"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:25:06.844506 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-e2dec8bf-f894-4b65-936a-2e2871d6ddb3 req-c2e31fd5-2020-4914-ad0f-7817e6ebcd9d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:06.845679 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-e2dec8bf-f894-4b65-936a-2e2871d6ddb3 req-c2e31fd5-2020-4914-ad0f-7817e6ebcd9d service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:06.862410 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-e2dec8bf-f894-4b65-936a-2e2871d6ddb3 req-c2e31fd5-2020-4914-ad0f-7817e6ebcd9d service nova] Creating event network-changed:e9ea2a93-ce5d-4ee1-8b30-bec6d4315523 for instance e3e30334-7ae4-4d34-8c40-c24c23b7c72e on hv-cinder-maste Apr 01 10:25:06.873381 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-e2dec8bf-f894-4b65-936a-2e2871d6ddb3 req-c2e31fd5-2020-4914-ad0f-7817e6ebcd9d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050280 Apr 01 10:25:06.873987 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 526/1041] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:25:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 01 10:25:06.954675 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:06.964013 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-21f170a9-6fd3-493a-9893-df1eae6fb716 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.254360 Apr 01 10:25:06.964658 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 516/1042] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:06 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:07.986948 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:07.988105 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:07.998911 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:07.999672 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:08.001004 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:08.001725 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:08.145124 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:08.154112 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2a9dc8b8-2ff0-4ae9-b3a2-b7f23379e1c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.174975 Apr 01 10:25:08.154944 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 527/1043] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:07 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:09.171517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:09.172139 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:09.179454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:09.179972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:09.180752 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:09.181192 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:09.343842 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:09.351946 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5f05fc89-026e-4128-8bdb-be8b8cf588e7 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.184343 Apr 01 10:25:09.352523 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 517/1044] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:09 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:10.369546 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:10.370192 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:10.377201 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:10.377655 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:10.378434 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:10.378943 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:10.536143 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:10.544512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-166dd2e0-d63b-43c9-9595-b0f7fadc380a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.179044 Apr 01 10:25:10.545087 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 528/1045] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:10 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:11.565875 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:11.566938 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:11.577698 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:11.578511 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:11.579851 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:11.580593 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:11.717830 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:11.726098 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-26e34871-a1fb-479f-ae20-b635ab72277c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.166733 Apr 01 10:25:11.726663 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 518/1046] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:11 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:12.744827 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:12.745663 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:12.753902 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:12.754509 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:12.755515 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:12.756056 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:12.891705 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:12.899380 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-8069714d-122f-4819-95b4-20c8a62215c6 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.159407 Apr 01 10:25:12.899959 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 529/1047] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:12 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:13.920473 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:13.921453 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:13.931226 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:13.931681 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:13.932454 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:13.932889 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:14.088011 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:14.097082 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-e331fff9-6294-43e2-92c9-150859c13171 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.183203 Apr 01 10:25:14.097654 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 519/1048] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:13 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:15.117736 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:15.119014 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:15.125482 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:15.125930 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:15.126721 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:15.127151 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:15.266905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:15.274578 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-6616a183-ba96-4bc5-bfad-0e741ea5210d tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.160831 Apr 01 10:25:15.275139 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 530/1049] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:15 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:16.295059 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:16.296025 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:16.305066 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:16.305516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:16.306286 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:16.306752 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:16.465215 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:16.472436 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-316e63f6-6ece-41e5-a59d-12c73fbeb92f tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.183884 Apr 01 10:25:16.473030 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 520/1050] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:16 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:16.611411 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-4a04e15c-f9ee-4d78-a5a9-62640633ecd0 req-5aeace3c-49c1-47ee-af6f-882211962518 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e30334-7ae4-4d34-8c40-c24c23b7c72e", "name": "network-vif-plugged", "status": "completed", "tag": "e9ea2a93-ce5d-4ee1-8b30-bec6d4315523"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:25:16.621021 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-4a04e15c-f9ee-4d78-a5a9-62640633ecd0 req-5aeace3c-49c1-47ee-af6f-882211962518 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:16.621464 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-4a04e15c-f9ee-4d78-a5a9-62640633ecd0 req-5aeace3c-49c1-47ee-af6f-882211962518 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:16.632647 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-4a04e15c-f9ee-4d78-a5a9-62640633ecd0 req-5aeace3c-49c1-47ee-af6f-882211962518 service nova] Creating event network-vif-plugged:e9ea2a93-ce5d-4ee1-8b30-bec6d4315523 for instance e3e30334-7ae4-4d34-8c40-c24c23b7c72e on hv-cinder-maste Apr 01 10:25:16.637778 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-4a04e15c-f9ee-4d78-a5a9-62640633ecd0 req-5aeace3c-49c1-47ee-af6f-882211962518 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030279 Apr 01 10:25:16.638370 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 531/1051] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:25:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:25:17.491404 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:17.492180 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:17.500639 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:17.501195 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:17.502157 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:17.502692 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:17.641161 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:17.649506 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-095ba1e4-7b2f-48c5-90c8-9d6ba2ccaf0b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1266 microversion: 2.1 time: 0.163223 Apr 01 10:25:17.650076 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 521/1052] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:17 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:18.672186 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:18.673337 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:18.681777 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:18.682221 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:18.683020 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:18.683449 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:18.824208 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:18.836091 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2ab35bbf-60ff-4405-be96-c1da63e0b19b tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1452 microversion: 2.1 time: 0.171433 Apr 01 10:25:18.836905 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 532/1053] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:18 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1452 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:18.857457 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:25:18.858075 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:25:18.864802 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:18.865257 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:18.866038 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:18.866469 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:19.008168 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:25:19.016382 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-74dc26a7-7669-4409-b91f-570892d73683 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1452 microversion: 2.1 time: 0.162740 Apr 01 10:25:19.016869 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 522/1054] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:25:18 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:25:20.931128 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-5bb9eec6-d13b-4849-ac18-1aa82a144fb9 req-f4aea5fd-feea-4217-a281-e2ae827bdf27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e30334-7ae4-4d34-8c40-c24c23b7c72e", "tag": "e9ea2a93-ce5d-4ee1-8b30-bec6d4315523"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:25:20.938325 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-5bb9eec6-d13b-4849-ac18-1aa82a144fb9 req-f4aea5fd-feea-4217-a281-e2ae827bdf27 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:25:20.938803 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-5bb9eec6-d13b-4849-ac18-1aa82a144fb9 req-f4aea5fd-feea-4217-a281-e2ae827bdf27 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:25:20.950330 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-5bb9eec6-d13b-4849-ac18-1aa82a144fb9 req-f4aea5fd-feea-4217-a281-e2ae827bdf27 service nova] Creating event network-changed:e9ea2a93-ce5d-4ee1-8b30-bec6d4315523 for instance e3e30334-7ae4-4d34-8c40-c24c23b7c72e on hv-cinder-maste Apr 01 10:25:20.955738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-5bb9eec6-d13b-4849-ac18-1aa82a144fb9 req-f4aea5fd-feea-4217-a281-e2ae827bdf27 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029851 Apr 01 10:25:20.956399 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 533/1055] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:25:56.064125 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:25:56.065769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:25:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:26:02.947951 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:26:02.948935 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:26:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:27:16.308239 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1696379705", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1093465623", "security_groups": [{"name": "tempest-secgroup-smoke-1720076103"}], "block_device_mapping_v2": [{"uuid": "4239e3b7-088a-47a2-8e6d-88b19412f3ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c2ea6cd2-7b6c-4468-8631-0d4f84d24ae3"}]}} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:27:16.423584 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.network.neutron [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] validate_networks() for [('c2ea6cd2-7b6c-4468-8631-0d4f84d24ae3', None, None, None, None, None)] {{(pid=117066) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Apr 01 10:27:16.853660 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Flavor limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 01 10:27:16.854086 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Image limits 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 01 10:27:16.854561 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Flavor pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 01 10:27:16.855007 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Image pref 0:0:0 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 01 10:27:16.855417 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.virt.hardware [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117066) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 01 10:27:16.866584 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:16.867146 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:16.868015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:16.868450 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:16.885838 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for project 246bc36f10274d35821692e2c7fed45a. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 01 10:27:16.890702 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.quota [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Getting quotas for user 3915ad324c4c4f1da32715584f8d9ca7 and project 246bc36f10274d35821692e2c7fed45a. Resources: {'cores', 'ram', 'instances'} {{(pid=117066) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 01 10:27:16.947763 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Going to run 1 instances... {{(pid=117066) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Apr 01 10:27:16.949857 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4239e3b7-088a-47a2-8e6d-88b19412f3ad',volume_size=None,volume_type=None)] {{(pid=117066) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Apr 01 10:27:17.087576 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-cb04f718-028c-4a04-93e5-586a49275911 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.784003 Apr 01 10:27:17.088471 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 523/1056] 10.222.0.46 () {60 vars in 1146 bytes} [Fri Apr 1 10:27:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 786 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 01 10:27:17.096915 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e9936db0-33c7-44dd-9842-748b878c0c8e] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Apr 01 10:27:17.101271 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-5d24655d-8742-4338-aa37-1ae543bc3095 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:17.101997 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-5d24655d-8742-4338-aa37-1ae543bc3095 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:17.156100 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-5d24655d-8742-4338-aa37-1ae543bc3095 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:17.163276 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-5d24655d-8742-4338-aa37-1ae543bc3095 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1095 microversion: 2.1 time: 0.068564 Apr 01 10:27:17.163844 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 534/1057] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:17 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:18.181086 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:18.181671 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:18.188633 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:18.189091 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:18.189865 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:18.190304 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:18.258767 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:18.266723 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-15b193b0-4c5a-4d32-a294-aa4a73692878 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1211 microversion: 2.1 time: 0.090210 Apr 01 10:27:18.267514 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 524/1058] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:18 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1211 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:19.284626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:19.285331 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:19.294962 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:19.295424 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:19.296219 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:19.296658 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:19.303202 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] [e9936db0-33c7-44dd-9842-748b878c0c8e] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 58870. Apr 01 10:27:19.442083 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:19.450426 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2eafc29f-9fa6-4bd7-ab02-5d80a0031ba8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.169911 Apr 01 10:27:19.451046 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 535/1059] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:19 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:19.759120 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-d14759c1-898b-4e24-a648-e9c151d6e121 req-a24a9cfc-5eb1-4ab1-80d1-3f4f56a6009e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c7a093-2c77-444c-8c95-699cd2c0d22a", "tag": "17dfcf88-e9c7-43eb-99be-53e261b2482a"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:27:19.767857 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-d14759c1-898b-4e24-a648-e9c151d6e121 req-a24a9cfc-5eb1-4ab1-80d1-3f4f56a6009e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:19.768291 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-d14759c1-898b-4e24-a648-e9c151d6e121 req-a24a9cfc-5eb1-4ab1-80d1-3f4f56a6009e service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:19.780004 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-d14759c1-898b-4e24-a648-e9c151d6e121 req-a24a9cfc-5eb1-4ab1-80d1-3f4f56a6009e service nova] Creating event network-changed:17dfcf88-e9c7-43eb-99be-53e261b2482a for instance a3c7a093-2c77-444c-8c95-699cd2c0d22a on hv-cinder-maste Apr 01 10:27:19.785351 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-d14759c1-898b-4e24-a648-e9c151d6e121 req-a24a9cfc-5eb1-4ab1-80d1-3f4f56a6009e service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.152794 Apr 01 10:27:19.785972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 525/1060] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:27:20.468030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:20.468632 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:20.475540 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:20.475999 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:20.476793 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:20.477225 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:20.616900 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:20.624703 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-910a73f9-9e69-4906-b9f6-ef8b80521c27 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.160803 Apr 01 10:27:20.625244 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 536/1061] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:20 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:21.647006 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:21.648145 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:21.659244 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:21.659990 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:21.661264 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:21.661987 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:21.804507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:21.815189 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-7b2d48ce-385a-40f0-bd21-928723fd38ac tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.175102 Apr 01 10:27:21.815729 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 526/1062] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:21 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:22.837193 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:22.837733 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:22.844543 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:22.844985 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:22.845766 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:22.846197 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:22.993791 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:23.001356 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-677dfd61-30de-463b-8095-91bf482e0738 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.170707 Apr 01 10:27:23.001936 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 537/1063] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:22 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:24.022675 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:24.023756 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:24.034539 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:24.035321 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:24.036659 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:24.037386 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:24.179550 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:24.190938 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b6796e06-5411-4084-a804-200cd9c5d725 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.174331 Apr 01 10:27:24.191634 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 527/1064] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:24 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:25.210002 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:25.210834 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:25.218145 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:25.218621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:25.219465 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:25.219923 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:25.367154 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:25.375198 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-c495024f-02e5-4a91-b640-74c3ba3324b2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.170482 Apr 01 10:27:25.375769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 538/1065] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:25 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:25.963805 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:27:25.964061 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:27:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:27:26.392460 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:26.393104 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:26.402034 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:26.402485 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:26.403328 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:26.403768 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:26.658975 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:26.667121 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-09b56dd0-e28a-4ea3-a089-e510383209ec tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.278981 Apr 01 10:27:26.667709 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 528/1066] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:26 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:27.684492 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:27.685138 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:27.692053 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:27.692491 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:27.693303 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:27.693738 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:27.835089 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:27.846193 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-f180df33-f806-4951-a76d-e70287405507 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.165800 Apr 01 10:27:27.847029 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 539/1067] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:27 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:28.869475 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:28.870281 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:28.878705 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:28.879297 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:28.880247 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:28.880789 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:29.024919 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:29.032268 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6f15fed3-78dc-40de-830a-e8f0b7fca3a4 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.169654 Apr 01 10:27:29.032832 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 529/1068] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:28 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:30.049657 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:30.050972 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:30.057682 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:30.058136 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:30.058921 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:30.059357 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:30.202998 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:30.214390 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-0359f33e-3855-4786-9958-d5300476fed8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.168406 Apr 01 10:27:30.215179 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 540/1069] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:30 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:31.231972 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:31.232587 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:31.239472 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:31.239957 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:31.240748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:31.241185 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:31.332435 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [req-d3653a3c-a85d-46e6-aea4-dbacd7e4f853 req-31d961a4-47a3-4d87-b12d-b17e408fa9b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c7a093-2c77-444c-8c95-699cd2c0d22a", "name": "network-vif-plugged", "status": "completed", "tag": "17dfcf88-e9c7-43eb-99be-53e261b2482a"}]} {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:27:31.341429 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-d3653a3c-a85d-46e6-aea4-dbacd7e4f853 req-31d961a4-47a3-4d87-b12d-b17e408fa9b4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:31.341859 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [req-d3653a3c-a85d-46e6-aea4-dbacd7e4f853 req-31d961a4-47a3-4d87-b12d-b17e408fa9b4 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:31.354921 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.compute.server_external_events [req-d3653a3c-a85d-46e6-aea4-dbacd7e4f853 req-31d961a4-47a3-4d87-b12d-b17e408fa9b4 service nova] Creating event network-vif-plugged:17dfcf88-e9c7-43eb-99be-53e261b2482a for instance a3c7a093-2c77-444c-8c95-699cd2c0d22a on hv-cinder-maste Apr 01 10:27:31.358876 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: ERROR oslo.messaging._drivers.impl_rabbit [req-d3653a3c-a85d-46e6-aea4-dbacd7e4f853 req-31d961a4-47a3-4d87-b12d-b17e408fa9b4 service nova] [3db478b1-0e3f-44f0-8543-83b23cd543fd] AMQP server on 10.222.0.46:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 01 10:27:31.384844 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:31.392805 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b41e802e-7c60-40bb-9d25-000ccbfb84f8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.165040 Apr 01 10:27:31.393386 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 530/1070] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:31 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:32.370560 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [req-d3653a3c-a85d-46e6-aea4-dbacd7e4f853 req-31d961a4-47a3-4d87-b12d-b17e408fa9b4 service nova] [3db478b1-0e3f-44f0-8543-83b23cd543fd] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 58902. Apr 01 10:27:32.376874 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [req-d3653a3c-a85d-46e6-aea4-dbacd7e4f853 req-31d961a4-47a3-4d87-b12d-b17e408fa9b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.047891 Apr 01 10:27:32.378063 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 541/1071] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:27:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:27:32.409426 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:32.410185 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:32.417171 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:32.417616 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:32.418385 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:32.418854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:32.566516 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:32.575238 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6e57c0a2-8541-4c30-9269-72c9e7626150 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.169622 Apr 01 10:27:32.576770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 531/1072] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:32 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:33.599715 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:33.600874 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:33.609801 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:33.610257 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:33.611073 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:33.611512 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:33.763238 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:33.771535 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-04cdd7fe-4161-4367-8683-30da93bc9f30 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1267 microversion: 2.1 time: 0.179705 Apr 01 10:27:33.772079 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 542/1073] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:33 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1267 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:34.792833 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:34.793694 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:34.804345 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:34.805105 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:34.806384 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:34.807168 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:34.949608 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:34.961087 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-f073d65f-b07e-4e46-87c3-db9393d3f3da tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1453 microversion: 2.1 time: 0.174681 Apr 01 10:27:34.961840 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 532/1074] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:34 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1453 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:34.977425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:27:34.978046 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:27:34.984563 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:34.985016 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:34.985785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:34.986222 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:35.138199 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:27:35.146033 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-e9b3dda2-db76-4269-ba34-5de4e7b8f6a8 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1453 microversion: 2.1 time: 0.172451 Apr 01 10:27:35.146606 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 543/1075] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:27:34 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1453 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:27:37.131044 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-795db90c-784d-48e6-a0bc-15c49cd84605 req-28b9a185-e1de-42fb-a443-e2143ed559a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c7a093-2c77-444c-8c95-699cd2c0d22a", "tag": "17dfcf88-e9c7-43eb-99be-53e261b2482a"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:27:37.139194 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-795db90c-784d-48e6-a0bc-15c49cd84605 req-28b9a185-e1de-42fb-a443-e2143ed559a9 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:27:37.139642 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-795db90c-784d-48e6-a0bc-15c49cd84605 req-28b9a185-e1de-42fb-a443-e2143ed559a9 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:27:37.150408 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-795db90c-784d-48e6-a0bc-15c49cd84605 req-28b9a185-e1de-42fb-a443-e2143ed559a9 service nova] Creating event network-changed:17dfcf88-e9c7-43eb-99be-53e261b2482a for instance a3c7a093-2c77-444c-8c95-699cd2c0d22a on hv-cinder-maste Apr 01 10:27:37.155651 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-795db90c-784d-48e6-a0bc-15c49cd84605 req-28b9a185-e1de-42fb-a443-e2143ed559a9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083428 Apr 01 10:27:37.156260 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 533/1076] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:27:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:28:10.312407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:28:10.313584 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:28:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:29:16.077500 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:29:16.078530 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:29:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:29:31.013809 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:31.014457 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:31.017854 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-f19d7186-8210-4e55-af43-54d5cbc8fd18 req-0d32034e-1e18-4ef0-b19a-fdbd99f521a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3c7a093-2c77-444c-8c95-699cd2c0d22a", "tag": "17dfcf88-e9c7-43eb-99be-53e261b2482a"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:29:31.021001 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:31.021522 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:31.022359 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:31.022877 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:31.026181 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-f19d7186-8210-4e55-af43-54d5cbc8fd18 req-0d32034e-1e18-4ef0-b19a-fdbd99f521a1 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:31.026830 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-f19d7186-8210-4e55-af43-54d5cbc8fd18 req-0d32034e-1e18-4ef0-b19a-fdbd99f521a1 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:31.037995 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-f19d7186-8210-4e55-af43-54d5cbc8fd18 req-0d32034e-1e18-4ef0-b19a-fdbd99f521a1 service nova] Creating event network-changed:17dfcf88-e9c7-43eb-99be-53e261b2482a for instance a3c7a093-2c77-444c-8c95-699cd2c0d22a on hv-cinder-maste Apr 01 10:29:31.043624 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-f19d7186-8210-4e55-af43-54d5cbc8fd18 req-0d32034e-1e18-4ef0-b19a-fdbd99f521a1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032147 Apr 01 10:29:31.044748 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 534/1077] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:29:31.048505 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:29:31.142799 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-9ecb42da-380f-48b3-8424-2269848a7b19 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "DELETE /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 204 len: 0 microversion: 2.1 time: 0.133826 Apr 01 10:29:31.146444 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 544/1078] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:29:31 2022] DELETE /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:29:31.152851 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:31.153539 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:31.161023 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:31.161509 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:31.162302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:31.162770 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:31.396238 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:29:31.404336 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-b83657ae-b730-49e9-a6c6-419415aa7444 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1578 microversion: 2.1 time: 0.256066 Apr 01 10:29:31.404895 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 535/1079] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:31 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1578 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:29:32.422430 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:32.423030 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:32.429785 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:32.430259 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:32.431063 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:32.431499 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:32.572606 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:29:32.581101 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-1c79d5a8-d969-4882-bcd7-1bbc5a6a850a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1459 microversion: 2.1 time: 0.163169 Apr 01 10:29:32.581651 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 545/1080] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:32 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1459 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:29:33.350333 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-be6f01e0-4715-43fb-bd69-6dd1b7ffba43 req-4461f79b-aa4b-4451-bd9f-fa5cdab6a28a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3c7a093-2c77-444c-8c95-699cd2c0d22a", "name": "network-vif-deleted", "tag": "17dfcf88-e9c7-43eb-99be-53e261b2482a"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:29:33.358964 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-be6f01e0-4715-43fb-bd69-6dd1b7ffba43 req-4461f79b-aa4b-4451-bd9f-fa5cdab6a28a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:33.359407 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-be6f01e0-4715-43fb-bd69-6dd1b7ffba43 req-4461f79b-aa4b-4451-bd9f-fa5cdab6a28a service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:33.370509 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-be6f01e0-4715-43fb-bd69-6dd1b7ffba43 req-4461f79b-aa4b-4451-bd9f-fa5cdab6a28a service nova] Creating event network-vif-deleted:17dfcf88-e9c7-43eb-99be-53e261b2482a for instance a3c7a093-2c77-444c-8c95-699cd2c0d22a on hv-cinder-maste Apr 01 10:29:33.376135 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-be6f01e0-4715-43fb-bd69-6dd1b7ffba43 req-4461f79b-aa4b-4451-bd9f-fa5cdab6a28a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029643 Apr 01 10:29:33.376726 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 536/1081] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:29:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:29:33.599595 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:33.600200 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:33.607014 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:33.607448 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:33.608432 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:33.608856 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:33.675789 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:29:33.684297 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-88473c78-11a8-46b3-82c4-ad1388502b50 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 200 len: 1226 microversion: 2.1 time: 0.088636 Apr 01 10:29:33.684878 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 546/1082] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:33 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 1226 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:29:34.707320 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:34.708455 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: a3c7a093-2c77-444c-8c95-699cd2c0d22a] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:34.715668 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:34.716117 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:34.716843 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:34.717302 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:34.730536 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] HTTP exception thrown: Instance a3c7a093-2c77-444c-8c95-699cd2c0d22a could not be found. Apr 01 10:29:34.731155 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Returning 404 to user: Instance a3c7a093-2c77-444c-8c95-699cd2c0d22a could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:29:34.731962 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-5d748c1c-a6be-4dfe-8234-1cfbbe4bfd47 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a" status: 404 len: 111 microversion: 2.1 time: 0.032466 Apr 01 10:29:34.732476 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 537/1083] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:34 2022] GET /compute/v2.1/servers/a3c7a093-2c77-444c-8c95-699cd2c0d22a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:29:37.911085 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:37.911619 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:37.913580 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-8be4bcf3-90ea-441c-b341-8e2e349673cc req-e18dd47e-d4e0-486d-825e-23540e52abd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3e30334-7ae4-4d34-8c40-c24c23b7c72e", "tag": "e9ea2a93-ce5d-4ee1-8b30-bec6d4315523"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:29:37.918148 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:37.918607 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:37.919425 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:37.919851 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:37.922203 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-8be4bcf3-90ea-441c-b341-8e2e349673cc req-e18dd47e-d4e0-486d-825e-23540e52abd0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:37.922892 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-8be4bcf3-90ea-441c-b341-8e2e349673cc req-e18dd47e-d4e0-486d-825e-23540e52abd0 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:37.934507 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-8be4bcf3-90ea-441c-b341-8e2e349673cc req-e18dd47e-d4e0-486d-825e-23540e52abd0 service nova] Creating event network-changed:e9ea2a93-ce5d-4ee1-8b30-bec6d4315523 for instance e3e30334-7ae4-4d34-8c40-c24c23b7c72e on hv-cinder-maste Apr 01 10:29:37.939956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-8be4bcf3-90ea-441c-b341-8e2e349673cc req-e18dd47e-d4e0-486d-825e-23540e52abd0 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030249 Apr 01 10:29:37.940956 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 538/1084] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:29:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:29:37.946142 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Going to try to terminate instance {{(pid=117065) delete /opt/stack/nova/nova/compute/api.py:2664}} Apr 01 10:29:38.031988 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-2016d8ca-485d-4976-bf80-b0dcc6b9d39c tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "DELETE /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 204 len: 0 microversion: 2.1 time: 0.124561 Apr 01 10:29:38.033517 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 547/1085] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:29:37 2022] DELETE /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 01 10:29:38.042762 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:38.043483 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:38.049771 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:38.050228 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:38.051053 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:38.051495 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:38.282242 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.policy [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117066) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:29:38.292782 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-6c3eafd0-f66d-4c73-ba27-8bfb4a379374 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1576 microversion: 2.1 time: 0.254822 Apr 01 10:29:38.293579 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 539/1086] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:38 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:29:39.310232 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:39.310957 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:39.317621 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:39.318083 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:39.318919 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:39.319367 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:39.466126 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:29:39.474205 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-81b6c91a-5c1c-42f0-9472-a5906c4808fc tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1458 microversion: 2.1 time: 0.168225 Apr 01 10:29:39.474814 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 548/1087] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:39 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1458 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:29:40.372725 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [req-19a4b8f8-8801-480f-9852-f502eee0ed5b req-60b44011-baf0-4411-956a-4a9f49394aa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3e30334-7ae4-4d34-8c40-c24c23b7c72e", "name": "network-vif-deleted", "tag": "e9ea2a93-ce5d-4ee1-8b30-bec6d4315523"}]} {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 01 10:29:40.381900 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-19a4b8f8-8801-480f-9852-f502eee0ed5b req-60b44011-baf0-4411-956a-4a9f49394aa6 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:40.382349 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [req-19a4b8f8-8801-480f-9852-f502eee0ed5b req-60b44011-baf0-4411-956a-4a9f49394aa6 service nova] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:40.394274 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.compute.server_external_events [req-19a4b8f8-8801-480f-9852-f502eee0ed5b req-60b44011-baf0-4411-956a-4a9f49394aa6 service nova] Creating event network-vif-deleted:e9ea2a93-ce5d-4ee1-8b30-bec6d4315523 for instance e3e30334-7ae4-4d34-8c40-c24c23b7c72e on hv-cinder-maste Apr 01 10:29:40.399270 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [req-19a4b8f8-8801-480f-9852-f502eee0ed5b req-60b44011-baf0-4411-956a-4a9f49394aa6 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030313 Apr 01 10:29:40.399870 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 540/1088] 10.222.0.46 () {64 vars in 1317 bytes} [Fri Apr 1 10:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 01 10:29:40.491685 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:40.492231 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:40.499280 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:40.499769 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:40.500588 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:40.501024 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:40.562251 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.policy [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3915ad324c4c4f1da32715584f8d9ca7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '246bc36f10274d35821692e2c7fed45a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117065) authorize /opt/stack/nova/nova/policy.py:199}} Apr 01 10:29:40.570569 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-cd6e1127-110b-457f-9a0b-9080e5d8a23a tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 200 len: 1225 microversion: 2.1 time: 0.082763 Apr 01 10:29:40.575626 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 549/1089] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:40 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 01 10:29:41.593184 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:41.594331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: e3e30334-7ae4-4d34-8c40-c24c23b7c72e] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:41.604942 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:41.608303 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:41.609600 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:41.610331 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:41.627517 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] HTTP exception thrown: Instance e3e30334-7ae4-4d34-8c40-c24c23b7c72e could not be found. Apr 01 10:29:41.628096 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Returning 404 to user: Instance e3e30334-7ae4-4d34-8c40-c24c23b7c72e could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:29:41.628911 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-d167e12a-f258-4ec7-8102-adf646adc764 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e" status: 404 len: 111 microversion: 2.1 time: 0.043705 Apr 01 10:29:41.629431 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 541/1090] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:41 2022] GET /compute/v2.1/servers/e3e30334-7ae4-4d34-8c40-c24c23b7c72e => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:29:42.092928 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:42.093448 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.compute.api [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117065) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:42.103093 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:42.103543 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:42.104306 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:42.104732 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG oslo_concurrency.lockutils [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117065) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:42.119951 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.wsgi [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] HTTP exception thrown: Instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d could not be found. Apr 01 10:29:42.120531 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Returning 404 to user: Instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d could not be found. {{(pid=117065) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:29:42.121337 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-d8edba38-f044-4d83-a345-cf405ec8b497 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "DELETE /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 404 len: 111 microversion: 2.1 time: 0.034425 Apr 01 10:29:42.121890 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 550/1091] 10.222.0.46 () {58 vars in 1238 bytes} [Fri Apr 1 10:29:42 2022] DELETE /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:29:42.130145 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '>' {{(pid=117066) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:42.130786 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.compute.api [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] [instance: 70f8180a-a601-4ebb-a8b7-7be3e26a705d] Fetching instance by UUID {{(pid=117066) get /opt/stack/nova/nova/compute/api.py:2918}} Apr 01 10:29:42.137711 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:42.138154 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:42.138941 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Apr 01 10:29:42.139371 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG oslo_concurrency.lockutils [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Lock "99e219f2-f124-4025-bb90-a3ae1910c4c9" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117066) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Apr 01 10:29:42.153190 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.wsgi [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] HTTP exception thrown: Instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d could not be found. Apr 01 10:29:42.153766 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: DEBUG nova.api.openstack.wsgi [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Returning 404 to user: Instance 70f8180a-a601-4ebb-a8b7-7be3e26a705d could not be found. {{(pid=117066) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Apr 01 10:29:42.154565 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO nova.api.openstack.requestlog [None req-2ef527fa-332d-4b09-80c5-8c32dec74228 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d" status: 404 len: 111 microversion: 2.1 time: 0.028316 Apr 01 10:29:42.155113 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: [pid: 117066|app: 0|req: 542/1092] 10.222.0.46 () {58 vars in 1235 bytes} [Fri Apr 1 10:29:42 2022] GET /compute/v2.1/servers/70f8180a-a601-4ebb-a8b7-7be3e26a705d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 01 10:29:43.456022 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: DEBUG nova.api.openstack.wsgi [None req-bba33127-37e9-4f01-9336-67700c80ede2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] Calling method '.version_select at 0x7f64eda4e550>' {{(pid=117065) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 01 10:29:43.480667 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO nova.api.openstack.requestlog [None req-bba33127-37e9-4f01-9336-67700c80ede2 tempest-TestVolumeBootPattern-686768832 tempest-TestVolumeBootPattern-686768832-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1093465623" status: 202 len: 0 microversion: 2.1 time: 0.028526 Apr 01 10:29:43.481374 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: [pid: 117065|app: 0|req: 551/1093] 10.222.0.46 () {58 vars in 1262 bytes} [Fri Apr 1 10:29:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1093465623 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 01 10:30:45.974028 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:30:45.975375 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:30:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:31:30.325873 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:31:30.326912 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:31:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:32:36.089345 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:32:36.090316 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:32:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:32:41.833691 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:32:41.834773 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:32:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:32:42.967065 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:32:42.968015 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:32:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:32:54.862170 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:32:54.863353 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:32:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:34:05.987868 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:34:05.988886 dv-cinder-master-3-iscsi devstack@n-api.service[117065]: Fri Apr 1 10:34:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Apr 01 10:34:50.338604 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 01 10:34:50.339638 dv-cinder-master-3-iscsi devstack@n-api.service[117066]: Fri Apr 1 10:34:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!